00000001:02000400:1.0F:1787380068.898105:0:3295:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787380087.957275:0:3515:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1787380090.038952:0:3579:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 587 MB/s 00000001:01000000:3.0F:1787380090.292101:0:3579:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 662 MB/s 00000001:01000000:2.0:1787380090.542130:0:3579:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3723 MB/s 00000020:02000000:1.0:1787380091.289525:0:3608:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_116_gc06913e 00000400:02000000:1.0:1787380092.259041:0:3623:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.206.130@tcp [8/256/0/180] 00008000:02000000:0.0F:1787380096.068762:0:3773:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1787380148.659586:0:5740:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787380162.484429:0:6498:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787380162.484434:0:6498:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1787380162.484435:0:6498:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787380162.484588:0:6498:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000003ac4bdea 00000080:02000400:3.0:1787380162.484596:0:6498:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787380162.490138:0:6498:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787380162.490149:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787380162.490174:0:6498:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000001cd9ad22) 00000020:00000080:3.0:1787380162.490191:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787380162.556668:0:6498:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787380162.556748:0:6498:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1787380162.594788:0:6498:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787380162.595024:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787380162.595031:0:6498:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787380162.595042:0:6498:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3c46fdcad687e7 00000020:01000004:2.0:1787380162.595048:0:6498:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787380162.595053:0:6498:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787380162.595057:0:6498:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003ac4bdea from MGS 00000020:01000004:2.0:1787380162.595061:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787380162.595077:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000003425a61) 00000020:00000080:2.0:1787380162.595087:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787380162.595180:0:6498:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003ac4bdea from MGS, refs=2 00080000:01000000:2.0:1787380162.595185:0:6498:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787380162.595190:0:6498:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3c46fdcad687f5 00000100:00100000:2.0:1787380162.595275:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787380162.595390:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787380162.595396:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787380162.596163:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787380162.596171:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787380162.597037:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787380162.597178:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787380162.597184:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787380162.598710:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787380162.598719:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787380162.599192:0:6498:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787380162.599199:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787380162.600251:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380162.600254:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380162.600256:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380162.600734:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380162.600736:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380162.600738:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380162.601745:0:6498:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787380162.604429:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787380162.853556:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2419 MB/s 00000001:01000000:2.0:1787380163.102933:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2603 MB/s 00000001:01000000:3.0:1787380163.355294:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 523 MB/s 00000001:01000000:3.0:1787380163.605033:0:6498:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 647 MB/s 00080000:10000000:3.0:1787380163.618014:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1787380163.635357:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1787380163.637237:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787380163.637307:0:6498:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787380163.637380:0:6498:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787380163.637567:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787380163.637591:0:6498:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787380163.638080:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787380163.638211:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787380163.638216:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787380163.640405:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787380163.640416:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787380163.640794:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787380163.640800:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787380163.641351:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787380163.641371:0:6498:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.130@tcp' 00000020:01000004:3.0:1787380163.641373:0:6498:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787380163.641420:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.130@tcp (typ=mgc) 00000020:00000080:3.0:1787380163.641430:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.130@tcp (00000000052e9bf9) 00000020:00000080:3.0:1787380163.641445:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:0.0:1787380163.641613:0:6517:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:3.0:1787380163.643529:0:6498:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c6e31063@MGC192.168.206.130@tcp: add connection 192.168.206.130@tcp at head 00010000:00010000:3.0:1787380163.643684:0:6498:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.130@tcp-0 is initialized 00000040:01000000:3.0:1787380163.643691:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.130@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787380163.645294:0:6518:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787380163.645436:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.130@tcp (uuid c1e31f5e-7395-4c34-a795-7159073dc2a2) 00000020:00000080:3.0:1787380163.645457:0:6498:0:(genops.c:1406:class_connect()) connect: client c1e31f5e-7395-4c34-a795-7159073dc2a2, cookie 0xcf3c46fdcad68803 00000100:00080000:3.0:1787380163.645468:0:6498:0:(import.c:510:import_select_connection()) MGC192.168.206.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787380163.645480:0:6498:0:(import.c:624:import_select_connection()) MGC192.168.206.130@tcp: import 00000000c6e31063 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1787380163.645530:0:6498:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000011874e30 x1874203867349120/t0(0) o250->MGC192.168.206.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787380163.645556:0:6498:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c1e31f5e-7395-4c34-a795-7159073dc2a2->MGS 00000020:01000004:3.0:1787380163.645574:0:6498:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787380163.645579:0:6498:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787380163.645591:0:6498:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000e5cc5396) 00000020:00000080:3.0:1787380163.645602:0:6498:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787380163.648576:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000011874e30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1e31f5e-7395-4c34-a795-7159073dc2a2:3638:1874203867349120:0@lo:250: 00000100:00100000:0.0:1787380163.648666:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380163.648737:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867349120 00000100:00100000:0.0:1787380163.648744:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867349120 00000100:00100000:0.0:1787380163.648780:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787380163.648786:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfaa5ef0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3638:x1874203867349120:12345-0@lo:250: 00010000:00080000:0.0:1787380163.648822:0:6513:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from c1e31f5e-7395-4c34-a795-7159073dc2a2@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:0.0:1787380163.648847:0:6513:0:(genops.c:1406:class_connect()) connect: client c1e31f5e-7395-4c34-a795-7159073dc2a2, cookie 0xcf3c46fdcad68811 00000100:00080000:0.0:1787380163.648963:0:6513:0:(import.c:65:import_set_state_nolock()) 00000000c70d8e39 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787380163.649025:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfaa5ef0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:3638:x1874203867349120:12345-0@lo:250: Request processed in 238us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380163.649033:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787380163.649088:0:3638:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.206.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787380163.649096:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.130@tcp: connect to target with instance 0 00000100:00080000:0.0:1787380163.649102:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787380163.649106:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787380163.649109:0:3638:0:(import.c:65:import_set_state_nolock()) 00000000c6e31063 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787380163.649112:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787380163.649119:0:3638:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787380163.649123:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000011874e30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1e31f5e-7395-4c34-a795-7159073dc2a2:3638:1874203867349120:0@lo:250: 00010000:00010000:3.0:1787380163.660614:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380163.666079:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787380163.666254:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787380163.666260:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787380163.667614:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787380163.667625:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787380163.668010:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787380163.668016:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787380163.670536:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787380163.671273:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787380163.671281:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787380163.672902:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787380163.672913:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787380163.747435:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787380163.749113:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787380163.749123:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787380163.754091:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787380163.754107:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787380163.757081:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787380163.757234:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787380163.757240:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787380163.758643:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787380163.758653:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787380163.759282:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787380163.759422:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787380163.759427:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787380163.760043:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787380163.760051:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787380163.760762:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787380163.761718:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787380163.761725:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787380163.762432:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787380163.762441:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787380163.794330:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787380163.794660:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787380163.794666:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787380163.799010:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787380163.799026:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787380163.801243:0:6498:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787380163.801254:0:6498:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787380163.805681:0:6498:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787380163.805725:0:6498:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1787380163.805730:0:6498:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787380163.805931:0:6498:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787380163.805969:0:6498:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.130@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787380163.805974:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787380163.805976:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787380163.805977:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380163.805978:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380163.805979:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380163.805980:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380163.805982:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787380163.805983:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787380163.805984:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787380163.805985:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787380163.805991:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380163.805992:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787380163.806007:0:6498:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787380163.806009:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787380163.806010:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787380163.806011:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380163.806012:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380163.806016:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380163.806017:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380163.806017:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787380163.806018:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787380163.806019:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787380163.806020:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787380163.806021:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380163.806021:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787380163.806063:0:6498:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787380163.806080:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064ad054a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867349248:0@lo:253: 00000100:00100000:1.0:1787380163.806152:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380163.806240:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cd55ab8c going to sleep for 11 seconds 00000100:00100000:0.0:1787380163.806291:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867349248 00000100:00100000:0.0:1787380163.806297:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867349248 00000100:00100000:0.0:1787380163.806393:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787380163.806402:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fff365e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:6498:x1874203867349248:12345-0@lo:253: 20000000:01000000:0.0:1787380163.806446:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787380163.806449:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1787380163.806845:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787380163.806916:0:6516:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787380163.807175:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380163.809675:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787380163.810032:0:6516:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787380163.810036:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787380163.810041:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787380163.810044:0:6516:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787380163.810056:0:6516:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787380163.810260:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787380163.810440:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787380163.810454:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787380163.810486:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787380163.810503:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787380163.810530:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787380163.810654:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787380163.810663:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787380163.810676:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787380163.810682:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787380163.810694:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787380163.810699:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787380163.810712:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787380163.810738:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787380163.810767:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787380163.810772:0:6516:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787380163.810779:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787380163.811707:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787380163.811723:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787380163.811741:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787380163.811757:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787380163.811770:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787380163.811780:0:6516:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787380163.811805:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787380163.812055:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787380163.812070:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787380163.812085:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787380163.812098:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787380163.812105:0:6516:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787380163.812129:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787380163.812136:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787380163.812147:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787380163.812158:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787380163.812214:0:6516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787380163.812232:0:6516:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787380163.812238:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1787380163.813174:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1787380163.813394:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1787380163.813425:0:6516:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.130@tcp for mdt 20000000:01000000:0.0:1787380163.813427:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.130@tcp (null) (null) (null) 00000040:00080000:0.0:1787380163.813444:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1787380163.813450:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787380163.813463:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1787380163.813781:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.130@tcp (null) (null) 00000040:00080000:0.0:1787380163.813803:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1787380163.814068:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1787380163.814100:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1787380163.814117:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1787380163.814146:0:6516:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787380163.814149:0:6516:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787380163.814152:0:6516:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787380163.814201:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787380163.814204:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787380163.816771:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1787380163.817243:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787380163.817271:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1787380163.817285:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1787380163.817295:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787380163.817298:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787380163.818060:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787380163.818229:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787380163.818252:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787380163.818265:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1787380163.818275:0:6516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787380163.818278:0:6516:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1787380163.818282:0:6516:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787380163.818284:0:6516:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787380163.818289:0:6516:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787380163.818295:0:6516:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787380163.818728:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1787380163.818979:0:6516:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787380163.827613:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1787380163.827650:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1787380163.827668:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1787380163.827686:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787380163.827706:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e8cd1c3d/0xcf3c46fdcad68818 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380163.827724:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e8cd1c3d/0xcf3c46fdcad68818 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380163.827733:0:6516:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e8cd1c3d/0xcf3c46fdcad68818 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380163.827764:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e8cd1c3d/0xcf3c46fdcad68818 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380163.827770:0:6516:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e8cd1c3d/0xcf3c46fdcad68818 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380163.827776:0:6516:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e8cd1c3d/0xcf3c46fdcad68818 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380163.827781:0:6516:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e8cd1c3d already unused, calling callback (00000000e476b6df) 00010000:00010000:0.0:1787380163.827784:0:6516:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e8cd1c3d/0xcf3c46fdcad68818 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380163.827792:0:6516:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e8cd1c3d/0xcf3c46fdcad68818 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380163.827803:0:6516:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e8cd1c3d/0xcf3c46fdcad68818 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380163.827837:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e8cd1c3d/0xcf3c46fdcad68818 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380163.827844:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e8cd1c3d/0xcf3c46fdcad68818 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787380163.827859:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787380163.839491:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fff365e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:6498:x1874203867349248:12345-0@lo:253: Request processed in 33084us (33332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380163.839515:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787380163.839743:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064ad054a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867349248:0@lo:253: 10000000:01000000:1.0:1787380163.839782:0:6498:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787380163.839785:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787380163.839787:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787380163.839788:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380163.839789:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787380163.839790:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380163.839791:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380163.839793:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787380163.839794:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787380163.839796:0:6498:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787380163.839797:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380163.839798:0:6498:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787380163.839838:0:6498:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003ac4bdea from lustre-MDT0000 10000000:01000000:1.0:1787380163.839864:0:6498:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787380163.839867:0:6498:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787380163.839870:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9d6ff8828000 10000000:01000000:1.0:1787380163.839874:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787380163.839880:0:6498:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9d6ff8828000 from 1 10000000:01000000:1.0:1787380163.839883:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787380163.839913:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 0000000041af641d/0xcf3c46fdcad6881f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380163.839922:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 0000000041af641d/0xcf3c46fdcad6881f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380163.839930:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 0000000041af641d/0xcf3c46fdcad6881f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380163.839946:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064ad054a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867349376:0@lo:101: 00000100:00100000:1.0:1787380163.839981:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380163.840030:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000018a2d296 going to sleep for 11 seconds 00000100:00100000:0.0:1787380163.840105:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867349376 00000100:00100000:0.0:1787380163.840119:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867349376 00000100:00100000:0.0:1787380163.840163:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787380163.840171:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf9d143c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:6498:x1874203867349376:12345-0@lo:101: 00010000:00010000:0.0:1787380163.840181:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380163.840191:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aa0b0317/0xcf3c46fdcad68826 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6881f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380163.840211:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aa0b0317/0xcf3c46fdcad68826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6881f expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380163.840219:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aa0b0317/0xcf3c46fdcad68826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6881f expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380163.840227:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aa0b0317, rc 0) 00000100:00100000:0.0:1787380163.840252:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf9d143c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+6:6498:x1874203867349376:12345-0@lo:101: Request processed in 83us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380163.840258:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787380163.840370:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064ad054a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867349376:0@lo:101: 00010000:00010000:1.0:1787380163.840390:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 0000000041af641d/0xcf3c46fdcad6881f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68826 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380163.840397:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 0000000041af641d/0xcf3c46fdcad6881f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68826 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380163.840440:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064ad054a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867349504:0@lo:501: 00000100:00100000:1.0:1787380163.840463:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380163.840500:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000018a2d296 going to sleep for 11 seconds 00000100:00100000:3.0:1787380163.840709:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867349504 00000100:00100000:3.0:1787380163.840714:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867349504 00000100:00100000:3.0:1787380163.840753:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380163.840759:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4d13452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+6:6498:x1874203867349504:12345-0@lo:501: 00000100:00100000:3.0:1787380163.840872:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4d13452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+6:6498:x1874203867349504:12345-0@lo:501: Request processed in 113us (408us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787380163.840880:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787380163.841050:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064ad054a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867349504:0@lo:501: 10000000:01000000:1.0:1787380163.841078:0:6498:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787380163.841097:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 0000000041af641d/0xcf3c46fdcad6881f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68826 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380163.841105:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 0000000041af641d/0xcf3c46fdcad6881f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68826 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380163.841112:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d6fc873b000 10000000:01000000:1.0:1787380163.841116:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787380163.841121:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d6fc873b000 10000000:01000000:1.0:1787380163.841123:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787380163.841125:0:6498:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9d6fc873b000 from 1 10000000:01000000:1.0:1787380163.841127:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787380163.841143:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000ce4c44c7/0xcf3c46fdcad6882d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380163.841149:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000ce4c44c7/0xcf3c46fdcad6882d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380163.841166:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000ce4c44c7/0xcf3c46fdcad6882d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380163.841178:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064ad054a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867349632:0@lo:101: 00000100:00100000:1.0:1787380163.841203:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380163.841231:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000018a2d296 going to sleep for 11 seconds 00000100:00100000:3.0:1787380163.841304:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867349632 00000100:00100000:3.0:1787380163.841308:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867349632 00000100:00100000:3.0:1787380163.841338:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787380163.841344:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2bbb8c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+6:6498:x1874203867349632:12345-0@lo:101: 00010000:00010000:3.0:1787380163.841351:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380163.841362:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fc30aa34/0xcf3c46fdcad68834 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6882d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380163.841376:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc30aa34/0xcf3c46fdcad68834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6882d expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380163.841395:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fc30aa34/0xcf3c46fdcad68834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6882d expref: 7 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380163.841403:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fc30aa34, rc 0) 00000100:00100000:3.0:1787380163.841439:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2bbb8c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+7:6498:x1874203867349632:12345-0@lo:101: Request processed in 95us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380163.841445:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787380163.841950:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064ad054a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867349632:0@lo:101: 00010000:00010000:1.0:1787380163.841962:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000ce4c44c7/0xcf3c46fdcad6882d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68834 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380163.841970:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000ce4c44c7/0xcf3c46fdcad6882d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68834 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380163.841980:0:6498:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787380163.842006:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000ce4c44c7/0xcf3c46fdcad6882d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68834 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380163.842013:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 00000000ce4c44c7/0xcf3c46fdcad6882d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68834 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380163.842020:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787380163.842024:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787380163.842028:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d6fc873b000 10000000:01000000:1.0:1787380163.842030:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787380163.842033:0:6498:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787380163.842035:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787380163.842047:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000514ad7d4/0xcf3c46fdcad6883b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380163.842060:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000514ad7d4/0xcf3c46fdcad6883b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380163.842066:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000514ad7d4/0xcf3c46fdcad6883b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380163.842078:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064ad054a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867349760:0@lo:101: 00000100:00100000:1.0:1787380163.842105:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380163.842135:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000018a2d296 going to sleep for 11 seconds 00000100:00100000:3.0:1787380163.842203:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867349760 00000100:00100000:3.0:1787380163.842207:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867349760 00000100:00100000:3.0:1787380163.842236:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787380163.842242:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbe7109a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+7:6498:x1874203867349760:12345-0@lo:101: 00010000:00010000:3.0:1787380163.842249:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380163.842256:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b1169cf6/0xcf3c46fdcad68842 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6883b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380163.842268:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b1169cf6/0xcf3c46fdcad68842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6883b expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380163.842275:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b1169cf6/0xcf3c46fdcad68842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6883b expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380163.842281:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b1169cf6, rc 0) 00000100:00100000:3.0:1787380163.842312:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbe7109a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+8:6498:x1874203867349760:12345-0@lo:101: Request processed in 71us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380163.842318:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787380163.842391:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064ad054a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867349760:0@lo:101: 00010000:00010000:1.0:1787380163.842399:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000514ad7d4/0xcf3c46fdcad6883b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68842 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380163.842405:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000514ad7d4/0xcf3c46fdcad6883b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68842 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380163.842444:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064ad054a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867349888:0@lo:501: 00000100:00100000:1.0:1787380163.842629:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380163.842680:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000018a2d296 going to sleep for 11 seconds 00000100:00100000:0.0:1787380163.843067:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867349888 00000100:00100000:0.0:1787380163.843073:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867349888 00000100:00100000:0.0:1787380163.843138:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787380163.843145:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7e913d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+8:6498:x1874203867349888:12345-0@lo:501: 00000100:00100000:0.0:1787380163.843251:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7e913d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+9:6498:x1874203867349888:12345-0@lo:501: Request processed in 108us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380163.843258:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787380163.843313:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064ad054a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867349888:0@lo:501: 00000100:00100000:1.0:1787380163.843341:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064ad054a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867350016:0@lo:503: 00000100:00100000:1.0:1787380163.843380:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380163.843769:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000018a2d296 going to sleep for 11 seconds 00000100:00100000:3.0:1787380163.843933:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867350016 00000100:00100000:3.0:1787380163.843938:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867350016 00000100:00100000:3.0:1787380163.843962:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787380163.843975:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000eeb81cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+9:6498:x1874203867350016:12345-0@lo:503: 00000100:00100000:3.0:1787380163.844175:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000eeb81cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+9:6498:x1874203867350016:12345-0@lo:503: Request processed in 200us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380163.844182:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787380163.844261:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064ad054a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867350016:0@lo:503: 00000100:00100000:2.0:1787380163.845074:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000808e6f5c pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:6543:1874203867350144:0@lo:502: 00000100:00100000:2.0:1787380163.845130:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380163.845165:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set 000000001131e1b5 going to sleep for 11 seconds 00000100:00100000:1.0:1787380163.845212:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867350144 00000100:00100000:1.0:1787380163.845223:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867350144 00000100:00100000:1.0:1787380163.845298:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787380163.845305:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8be396d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+9:6543:x1874203867350144:12345-0@lo:502: 00000100:00100000:1.0:1787380163.845403:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8be396d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+9:6543:x1874203867350144:12345-0@lo:502: Request processed in 99us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380163.845411:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787380163.845486:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000808e6f5c pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:6543:1874203867350144:0@lo:502: 00000020:01000000:2.0:1787380163.845517:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787380163.845527:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380163.845529:0:6543:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787380163.845535:0:6543:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787380163.845537:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787380163.845647:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000d9699570) 00000020:00000080:2.0:1787380163.845665:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787380163.845672:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787380163.845763:0:6543:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787380163.845771:0:6543:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3c46fdcad68850 00000020:00000080:2.0:1787380163.846036:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787380163.846041:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380163.846045:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380163.846046:0:6543:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787380163.846049:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787380163.846052:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380163.846058:0:6543:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787380163.846062:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787380163.846069:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000293fac1f) 00000020:00000080:2.0:1787380163.846079:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787380163.846082:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787380163.846084:0:6543:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787380163.846086:0:6543:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787380163.846091:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787380163.846135:0:6543:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003ac4bdea from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787380163.846147:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000a8b82e66) 00000020:00000080:2.0:1787380163.846154:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787380163.846215:0:6543:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787380163.846221:0:6543:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3c46fdcad68865 00000020:00000080:2.0:1787380163.846312:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787380163.846319:0:6543:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787380163.846324:0:6543:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcf3c46fdcad6886c 00080000:01000000:2.0:1787380163.846330:0:6543:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787380163.846333:0:6543:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3c46fdcad68873 00080000:10000000:2.0:1787380163.846969:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1787380163.847119:0:6543:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787380163.861451:0:6543:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1787380163.963138:0:6543:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787380163.963721:0:6543:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787380163.968070:0:6543:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787380163.968404:0:6543:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787380163.971395:0:6543:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000094d29f93) 00000020:00000080:2.0:1787380163.971417:0:6543:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787380163.971489:0:6543:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787380163.971496:0:6543:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3c46fdcad68881 00000020:00000080:2.0:1787380163.973151:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787380163.974219:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1787380163.978925:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1787380163.986208:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1787380163.995883:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1787380163.999902:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1787380164.002534:0:6543:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1787380164.004849:0:6543:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcf3c46fdcad68888 00000020:00000080:3.0:1787380164.006453:0:6543:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787380164.006467:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380164.006527:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380164.006530:0:6543:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787380164.006535:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380164.006539:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380164.006541:0:6543:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787380164.006544:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787380164.006545:0:6543:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787380164.006549:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380164.006551:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380164.006552:0:6543:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787380164.006554:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380164.006558:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380164.006559:0:6543:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787380164.006562:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787380164.006610:0:6543:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1787380164.006664:0:6543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000064ad054a pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:6543:1874203867350272:0@lo:502: 00000100:00100000:1.0:1787380164.006733:0:6543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380164.006790:0:6543:0:(client.c:2702:ptlrpc_set_wait()) set 000000008dde836d going to sleep for 11 seconds 00000100:00100000:0.0:1787380164.006903:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867350272 00000100:00100000:0.0:1787380164.006911:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867350272 00000100:00100000:0.0:1787380164.007033:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787380164.007041:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae6d9dcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+9:6543:x1874203867350272:12345-0@lo:502: 00000100:00100000:0.0:1787380164.007180:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae6d9dcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+9:6543:x1874203867350272:12345-0@lo:502: Request processed in 141us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380164.007194:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787380164.007343:0:6543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000064ad054a pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:6543:1874203867350272:0@lo:502: 00000020:01000000:3.0:1787380164.007366:0:6543:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380164.007370:0:6543:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380164.007371:0:6543:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1787380164.007375:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787380164.007525:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787380164.007545:0:6498:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787380164.007598:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000514ad7d4/0xcf3c46fdcad6883b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68842 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.007615:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 00000000514ad7d4/0xcf3c46fdcad6883b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68842 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380164.007623:0:6498:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6fc873b000 from 1 10000000:01000000:1.0:1787380164.007626:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787380164.007648:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000847d2d2c/0xcf3c46fdcad6888f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.007655:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000847d2d2c/0xcf3c46fdcad6888f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.007663:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000847d2d2c/0xcf3c46fdcad6888f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380164.007674:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e54fc420 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867350400:0@lo:101: 00000100:00100000:1.0:1787380164.007701:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380164.007730:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000001f6c92e going to sleep for 11 seconds 00000100:00100000:3.0:1787380164.007772:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867350400 00000100:00100000:3.0:1787380164.007777:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867350400 00000100:00100000:3.0:1787380164.007837:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787380164.007844:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001174d9d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+9:6498:x1874203867350400:12345-0@lo:101: 00010000:00010000:3.0:1787380164.007853:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380164.007865:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d67a4aeb/0xcf3c46fdcad68896 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6888f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380164.007884:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d67a4aeb/0xcf3c46fdcad68896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6888f expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380164.007893:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d67a4aeb/0xcf3c46fdcad68896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6888f expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380164.007911:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d67a4aeb, rc 0) 00000100:00100000:3.0:1787380164.007942:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001174d9d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+10:6498:x1874203867350400:12345-0@lo:101: Request processed in 100us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380164.008092:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e54fc420 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867350400:0@lo:101: 00010000:00010000:1.0:1787380164.008101:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000847d2d2c/0xcf3c46fdcad6888f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68896 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.008109:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000847d2d2c/0xcf3c46fdcad6888f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68896 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380164.008582:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e54fc420 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867350528:0@lo:256: 00000100:00100000:1.0:1787380164.008615:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380164.008643:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000001f6c92e going to sleep for 11 seconds 00000100:00100000:3.0:1787380164.008678:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787380164.008699:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867350528 00000100:00100000:3.0:1787380164.008702:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867350528 00000100:00100000:3.0:1787380164.008726:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787380164.008731:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076e1f956 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+10:6498:x1874203867350528:12345-0@lo:256: 20000000:01000000:3.0:1787380164.008743:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787380164.008748:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787380164.008795:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076e1f956 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+10:6498:x1874203867350528:12345-0@lo:256: Request processed in 64us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380164.008801:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787380164.008908:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e54fc420 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867350528:0@lo:256: 10000000:01000000:1.0:1787380164.009499:0:6498:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787380164.009847:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000847d2d2c/0xcf3c46fdcad6888f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68896 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.009859:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 00000000847d2d2c/0xcf3c46fdcad6888f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68896 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380164.009866:0:6498:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fc873b000 from 1 10000000:01000000:1.0:1787380164.009868:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787380164.009890:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000f5a28039/0xcf3c46fdcad6889d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.009896:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000f5a28039/0xcf3c46fdcad6889d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.009904:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000f5a28039/0xcf3c46fdcad6889d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380164.009917:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e54fc420 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867350656:0@lo:101: 00000100:00100000:1.0:1787380164.009960:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380164.009982:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000001f6c92e going to sleep for 11 seconds 00000100:00100000:3.0:1787380164.010137:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867350656 00000100:00100000:3.0:1787380164.010143:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867350656 00000100:00100000:3.0:1787380164.010174:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787380164.010179:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce89b6e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+10:6498:x1874203867350656:12345-0@lo:101: 00010000:00010000:3.0:1787380164.010189:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380164.010198:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b5d3b5dc/0xcf3c46fdcad688a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6889d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380164.010214:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b5d3b5dc/0xcf3c46fdcad688a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6889d expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380164.010222:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b5d3b5dc/0xcf3c46fdcad688a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6889d expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380164.010241:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b5d3b5dc, rc 0) 00000100:00100000:3.0:1787380164.010276:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce89b6e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+11:6498:x1874203867350656:12345-0@lo:101: Request processed in 96us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380164.010282:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787380164.010347:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e54fc420 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867350656:0@lo:101: 00010000:00010000:2.0:1787380164.010357:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000f5a28039/0xcf3c46fdcad6889d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad688a4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380164.010369:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000f5a28039/0xcf3c46fdcad6889d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad688a4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380164.010433:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000808e6f5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867350784:0@lo:501: 00000100:00100000:2.0:1787380164.010459:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380164.010479:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000012a58a87 going to sleep for 11 seconds 00000100:00100000:3.0:1787380164.010529:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867350784 00000100:00100000:3.0:1787380164.010534:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867350784 00000100:00100000:3.0:1787380164.010560:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787380164.010566:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083293768 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+11:6498:x1874203867350784:12345-0@lo:501: 00000100:00100000:3.0:1787380164.010688:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083293768 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+11:6498:x1874203867350784:12345-0@lo:501: Request processed in 122us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380164.010694:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787380164.010781:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000808e6f5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867350784:0@lo:501: 00000100:00100000:2.0:1787380164.010838:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000808e6f5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867350912:0@lo:503: 00000100:00100000:2.0:1787380164.010874:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380164.010889:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000012a58a87 going to sleep for 11 seconds 00000100:00100000:3.0:1787380164.011017:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867350912 00000100:00100000:3.0:1787380164.011021:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867350912 00000100:00100000:3.0:1787380164.011134:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787380164.011140:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e06d721 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+11:6498:x1874203867350912:12345-0@lo:503: 00000040:00080000:3.0:1787380164.011167:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787380164.011199:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e06d721 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+11:6498:x1874203867350912:12345-0@lo:503: Request processed in 60us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380164.011205:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787380164.011297:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000808e6f5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867350912:0@lo:503: 00000040:00080000:0.0:1787380164.012190:0:6547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787380164.012329:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787380164.012350:0:6498:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787380164.012364:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000f5a28039/0xcf3c46fdcad6889d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad688a4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380164.012374:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 00000000f5a28039/0xcf3c46fdcad6889d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad688a4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380164.012414:0:6498:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787380164.012417:0:6498:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d6fc873b000 10000000:01000000:2.0:1787380164.012420:0:6498:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d6fc873b000 10000000:01000000:2.0:1787380164.012423:0:6498:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787380164.012428:0:6498:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6fc873b000 from 1 10000000:01000000:2.0:1787380164.012431:0:6498:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787380164.012457:0:6498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 0000000013d2c87d/0xcf3c46fdcad688ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380164.012474:0:6498:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 0000000013d2c87d/0xcf3c46fdcad688ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380164.012483:0:6498:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 0000000013d2c87d/0xcf3c46fdcad688ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380164.012499:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000808e6f5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867351040:0@lo:101: 00000100:00100000:2.0:1787380164.012540:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380164.012572:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ea1898dd going to sleep for 11 seconds 00000100:00100000:1.0:1787380164.012628:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867351040 00000100:00100000:1.0:1787380164.012634:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867351040 00000100:00100000:1.0:1787380164.012665:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787380164.012670:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004571db62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+11:6498:x1874203867351040:12345-0@lo:101: 00010000:00010000:1.0:1787380164.012680:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380164.012690:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000575a65a/0xcf3c46fdcad688b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad688ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.012719:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000575a65a/0xcf3c46fdcad688b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad688ab expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.012727:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000575a65a/0xcf3c46fdcad688b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad688ab expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.012736:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000575a65a, rc 0) 00000100:00100000:1.0:1787380164.012763:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004571db62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:6498:x1874203867351040:12345-0@lo:101: Request processed in 93us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380164.012769:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787380164.012852:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000808e6f5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867351040:0@lo:101: 00010000:00010000:2.0:1787380164.012863:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 0000000013d2c87d/0xcf3c46fdcad688ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad688b2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380164.012871:0:6498:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 0000000013d2c87d/0xcf3c46fdcad688ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad688b2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380164.012908:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000808e6f5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867351168:0@lo:501: 00000100:00100000:2.0:1787380164.012929:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380164.013084:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ea1898dd going to sleep for 11 seconds 00000100:00100000:3.0:1787380164.013128:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867351168 00000100:00100000:3.0:1787380164.013132:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867351168 00000100:00100000:1.0:1787380164.013214:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787380164.013220:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4172277 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:6498:x1874203867351168:12345-0@lo:501: 00000100:00100000:1.0:1787380164.013316:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4172277 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:6498:x1874203867351168:12345-0@lo:501: Request processed in 96us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380164.013322:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787380164.013381:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000808e6f5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867351168:0@lo:501: 00000100:00100000:3.0:1787380164.013406:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d550f117 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867351296:0@lo:503: 00000100:00100000:3.0:1787380164.013438:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380164.013492:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 00000000267eccd3 going to sleep for 11 seconds 00000100:00100000:2.0:1787380164.013537:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867351296 00000100:00100000:2.0:1787380164.013541:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867351296 00000100:00100000:2.0:1787380164.013558:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787380164.013562:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b884da6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:6498:x1874203867351296:12345-0@lo:503: 00000100:00100000:2.0:1787380164.013631:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b884da6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:6498:x1874203867351296:12345-0@lo:503: Request processed in 68us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380164.013637:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787380164.013699:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d550f117 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867351296:0@lo:503: 00000100:00100000:3.0:1787380164.013978:0:6548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d550f117 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:6548:1874203867351424:0@lo:502: 00000100:00100000:3.0:1787380164.014018:0:6548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380164.014034:0:6548:0:(client.c:2702:ptlrpc_set_wait()) set 00000000961d3f52 going to sleep for 11 seconds 00000100:00100000:2.0:1787380164.014068:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867351424 00000100:00100000:2.0:1787380164.014071:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867351424 00000100:00100000:2.0:1787380164.014086:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787380164.014090:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9495c15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:6548:x1874203867351424:12345-0@lo:502: 00000100:00100000:2.0:1787380164.014153:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9495c15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:6548:x1874203867351424:12345-0@lo:502: Request processed in 62us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380164.014160:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787380164.014263:0:6548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d550f117 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:6548:1874203867351424:0@lo:502: 00000020:01000004:3.0:1787380164.014305:0:6548:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787380164.014317:0:6548:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000002b3a0351) 00000020:00000080:3.0:1787380164.014331:0:6548:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787380164.014480:0:6548:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003ac4bdea from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787380164.014484:0:6548:0:(tgt_mount.c:187:server_put_mount()) put mount 000000003ac4bdea from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787380164.014486:0:6548:0:(obd_mount.c:710:lustre_put_lsi()) put 000000003ac4bdea 4 00010000:00080000:3.0:1787380164.014510:0:6548:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b48383a4@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.130@tcp at head 00010000:00010000:3.0:1787380164.016627:0:6548:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1787380164.016726:0:6548:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787380164.016762:0:6548:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787380164.016772:0:6548:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcf3c46fdcad688c0 00000100:00080000:3.0:1787380164.016781:0:6548:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787380164.016786:0:6548:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b48383a4 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1787380164.016836:0:6548:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d550f117 x1874203867351552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787380164.016865:0:6548:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787380164.018834:0:6548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b792b396 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:6548:1874203867351680:0@lo:502: 00000100:00100000:1.0:1787380164.018909:0:6548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380164.018930:0:6548:0:(client.c:2702:ptlrpc_set_wait()) set 000000008dde836d going to sleep for 11 seconds 00000100:00100000:0.0:1787380164.019107:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867351680 00000100:00100000:0.0:1787380164.019114:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867351680 00000100:00100000:0.0:1787380164.019130:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d550f117 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874203867351552:0@lo:38: 00000100:00100000:0.0:1787380164.019172:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380164.019245:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787380164.019252:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039b7bf54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:6548:x1874203867351680:12345-0@lo:502: 00000100:00100000:0.0:1787380164.019340:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039b7bf54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:6548:x1874203867351680:12345-0@lo:502: Request processed in 88us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380164.019347:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787380164.019417:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867351552 00000100:00100000:1.0:1787380164.019421:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867351552 00000100:00100000:1.0:1787380164.019448:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380164.019452:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040cb962e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1874203867351552:12345-0@lo:38: 00000100:00100000:1.0:1787380164.019493:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040cb962e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1874203867351552:12345-0@lo:38: Request processed in 39us (320us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787380164.019499:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380164.019529:0:6548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b792b396 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:6548:1874203867351680:0@lo:502: 00000040:00080000:1.0:1787380164.019561:0:6548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787380164.019706:0:6498:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787380164.019727:0:6498:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787380164.019745:0:6498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 0000000013d2c87d/0xcf3c46fdcad688ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad688b2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380164.019755:0:6498:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 0000000013d2c87d/0xcf3c46fdcad688ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad688b2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787380164.019798:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787380164.019800:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787380164.019801:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380164.019802:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380164.019803:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380164.019805:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380164.019828:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787380164.019829:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787380164.019830:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787380164.019831:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787380164.019833:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380164.019834:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787380164.019837:0:6498:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787380164.019840:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787380164.019842:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787380164.019843:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380164.019844:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380164.019845:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380164.019846:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380164.019852:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787380164.019853:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787380164.019853:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787380164.019854:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787380164.019855:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380164.019856:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787380164.019870:0:6498:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787380164.019878:0:6498:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e20f03a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867351808:0@lo:253: 00000100:00100000:2.0:1787380164.019910:0:6498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380164.019922:0:6498:0:(client.c:2702:ptlrpc_set_wait()) set 0000000012a58a87 going to sleep for 11 seconds 00000100:00100000:0.0:1787380164.020069:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787380164.020076:0:3638:0:(import.c:65:import_set_state_nolock()) 00000000b48383a4 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787380164.020080:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787380164.020083:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d550f117 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874203867351552:0@lo:38: 00000100:00100000:0.0:1787380164.020099:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867351808 00000100:00100000:0.0:1787380164.020102:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867351808 00000100:00100000:0.0:1787380164.020131:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787380164.020136:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f3ebee4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:6498:x1874203867351808:12345-0@lo:253: 20000000:01000000:0.0:1787380164.020152:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787380164.020162:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787380164.027186:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787380164.027205:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787380164.027443:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f3ebee4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:6498:x1874203867351808:12345-0@lo:253: Request processed in 7303us (7529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380164.027454:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787380164.027582:0:6498:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e20f03a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:6498:1874203867351808:0@lo:253: 10000000:01000000:2.0:1787380164.027594:0:6498:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787380164.027597:0:6498:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787380164.027599:0:6498:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787380164.027600:0:6498:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380164.027602:0:6498:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380164.027603:0:6498:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380164.027604:0:6498:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380164.027605:0:6498:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787380164.027606:0:6498:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787380164.027608:0:6498:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787380164.027609:0:6498:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787380164.027610:0:6498:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380164.027612:0:6498:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787380164.027629:0:6498:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1787380164.027636:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787380164.027640:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787380164.027656:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b95db6de/0xcf3c46fdcad688c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.027669:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d67a4aeb/0xcf3c46fdcad68896 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6888f expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.027677:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b95db6de/0xcf3c46fdcad688c7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.027707:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d67a4aeb/0xcf3c46fdcad68896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad6888f expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.027720:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d67a4aeb/0xcf3c46fdcad68896 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad6888f expref: 11 pid: 6513 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380164.027731:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b792b396 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874203867351936:0@lo:104: 00000100:00100000:1.0:1787380164.027775:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380164.027848:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set 0000000001f6c92e going to sleep for 11 seconds 00000100:00100000:3.0:1787380164.027924:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867351936 00000100:00100000:3.0:1787380164.027932:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867351936 00000100:00100000:3.0:1787380164.027974:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787380164.027981:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006e15076 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:6537:x1874203867351936:12345-0@lo:104: 00010000:00010000:3.0:1787380164.027991:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: 00000000847d2d2c/0xcf3c46fdcad6888f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68896 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380164.028054:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787380164.028059:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006e15076 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:6537:x1874203867351936:12345-0@lo:104: Request processed in 80us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380164.028065:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787380164.028219:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380164.028224:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: 00000000847d2d2c/0xcf3c46fdcad6888f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68896 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380164.028231:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000847d2d2c already unused, calling callback (00000000a6065147) 10000000:00010000:0.0:1787380164.028234:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: 00000000847d2d2c/0xcf3c46fdcad6888f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68896 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380164.028241:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: 00000000847d2d2c/0xcf3c46fdcad6888f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68896 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380164.028248:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: 00000000847d2d2c/0xcf3c46fdcad6888f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68896 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380164.028253:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787380164.028285:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: 00000000847d2d2c/0xcf3c46fdcad6888f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68896 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380164.028292:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380164.028313:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: 00000000847d2d2c/0xcf3c46fdcad6888f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68896 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380164.028319:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: 00000000847d2d2c/0xcf3c46fdcad6888f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68896 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380164.028334:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380164.028336:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380164.028337:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380164.028355:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b792b396 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874203867351936:0@lo:104: 00010000:00010000:0.0:1787380164.028367:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b95db6de/0xcf3c46fdcad688c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380164.030030:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000953df3f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867352064:0@lo:103: 00000100:00100000:3.0:1787380164.030088:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380164.032629:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867352064 00000100:00100000:1.0:1787380164.032640:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867352064 00010000:00010000:1.0:1787380164.032672:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d67a4aeb/0xcf3c46fdcad68896 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6888f expref: 12 pid: 6513 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380164.032739:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380164.032747:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b0729ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:3640:x1874203867352064:12345-0@lo:103: 00010000:00010000:1.0:1787380164.032760:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380164.032765:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d67a4aeb/0xcf3c46fdcad68896 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6888f expref: 12 pid: 6513 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.032786:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d67a4aeb/0xcf3c46fdcad68896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad6888f expref: 12 pid: 6513 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.032801:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d67a4aeb/0xcf3c46fdcad68896 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad6888f expref: 12 pid: 6513 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.032917:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b95db6de/0xcf3c46fdcad688c7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.032925:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b95db6de/0xcf3c46fdcad688c7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787380164.032939:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005298673s 00010000:00010000:1.0:1787380164.032943:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b95db6de/0xcf3c46fdcad688c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.032949:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b95db6de/0xcf3c46fdcad688c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.032955:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b95db6de/0xcf3c46fdcad688c7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.032960:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b95db6de/0xcf3c46fdcad688c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.032965:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b95db6de already unused, calling callback (00000000e476b6df) 00010000:00010000:1.0:1787380164.032969:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b95db6de/0xcf3c46fdcad688c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.032975:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b95db6de/0xcf3c46fdcad688c7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380164.033225:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b95db6de/0xcf3c46fdcad688c7 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380164.033234:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b95db6de/0xcf3c46fdcad688c7 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1787380164.033251:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00010000:00010000:1.0:1787380164.033265:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b95db6de/0xcf3c46fdcad688c7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.033272:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b95db6de/0xcf3c46fdcad688c7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380164.033286:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380164.033403:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b0729ba pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+11:3640:x1874203867352064:12345-0@lo:103: Request processed in 657us (3315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380164.033412:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:2.0:1787380164.033414:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00000100:00100000:3.0:1787380164.033526:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000953df3f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867352064:0@lo:103: 00080000:10000000:2.0:1787380164.033857:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1787380164.034093:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787380164.034294:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1787380164.034456:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1787380164.035655:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1787380164.039157:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1787380164.039747:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1787380164.042040:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1787380164.042383:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1787380164.042545:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1787380164.053257:0:6498:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787380164.071442:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787380164.071474:0:6553:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787380164.071479:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787380164.074501:0:6554:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787380164.075774:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787380164.075922:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787380164.079179:0:6498:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787380164.079199:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787380164.080115:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787380164.081274:0:6498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787380164.083971:0:6498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787380164.084103:0:6498:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787380164.084332:0:6498:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787380164.084622:0:6498:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:0.0:1787380164.085121:0:6554:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:2.0:1787380164.086758:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1787380164.086939:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1787380164.087854:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1787380164.088014:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1787380164.088614:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1787380164.088787:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787380164.103424:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787380164.103662:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787380164.104159:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787380164.104270:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787380164.104575:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787380164.104703:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787380164.104877:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00000040:00080000:0.0:1787380164.105071:0:6554:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787380164.105135:0:6554:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787380164.105139:0:6554:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1787380164.105271:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787380164.105692:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787380164.105906:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787380164.106372:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787380164.106538:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787380164.106673:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787380164.106869:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787380164.107024:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787380164.107190:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787380164.107327:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787380164.107456:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787380164.107591:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787380164.107741:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787380164.107907:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787380164.108711:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787380164.108954:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787380164.109230:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787380164.112015:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787380164.113600:0:6498:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787380164.113857:0:6498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1787380164.126283:0:6498:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787380164.126323:0:6498:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb3a801933988 00100000:10000000:3.0:1787380164.126335:0:6498:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787380164.128636:0:6498:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787380164.128651:0:6498:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787380164.128670:0:6498:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787380164.128692:0:6498:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787380164.131410:0:6498:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787380164.131595:0:6498:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1787380164.688931:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380165.712562:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380166.735210:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380167.756009:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380168.794210:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787380169.031471:0:6799:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1787380169.357389:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787380169.357400:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787380169.357410:0:8:0:(import.c:65:import_set_state_nolock()) 00000000b48383a4 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787380169.357422:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b48383a4 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1787380169.357442:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a333557e x1874203867352320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787380169.357589:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a333557e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874203867352320:0@lo:38: 00000100:00100000:3.0:1787380169.357668:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380169.357874:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000961de3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867352192:0@lo:400: 00000100:00100000:2.0:1787380169.357908:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380169.357981:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867352320 00000100:00100000:2.0:1787380169.357988:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867352320 00000100:00100000:2.0:1787380169.358017:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787380169.358023:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c0e20a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1874203867352320:12345-0@lo:38: 00010000:00080000:2.0:1787380169.358047:0:6523:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:2.0:1787380169.358077:0:6523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcf3c46fdcad688ce 00000004:00100000:2.0:1787380169.358115:0:6523:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787380169.358213:0:6523:0:(import.c:65:import_set_state_nolock()) 0000000048cf0d63 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787380169.358263:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c0e20a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874203867352320:12345-0@lo:38: Request processed in 239us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380169.358283:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787380169.358307:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867352192 00000100:00100000:2.0:1787380169.358311:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867352192 00000100:00100000:2.0:1787380169.358339:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787380169.358344:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a320d6d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+11:3641:x1874203867352192:12345-0@lo:400: 00000100:00100000:2.0:1787380169.358377:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a320d6d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+11:3641:x1874203867352192:12345-0@lo:400: Request processed in 33us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380169.358383:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1787380169.358877:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a333557e x1874203867352320/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787380179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787380169.358893:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787380169.358899:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787380169.358904:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787380169.358906:0:3638:0:(import.c:65:import_set_state_nolock()) 00000000b48383a4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787380169.358911:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a333557e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874203867352320:0@lo:38: 00000100:00100000:2.0:1787380169.360882:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000961de3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867352192:0@lo:400: 00010000:00010000:0.0:1787380169.804250:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787380169.989251:0:6851:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787380169.989431:0:6851:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787380170.829075:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380171.852206:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380172.876064:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787380172.940161:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787380172.940169:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6fc873b000 from 3 10000000:01000000:3.0:1787380172.940174:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787380172.940391:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000cdb6afe7/0xcf3c46fdcad688d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380172.940403:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000cdb6afe7/0xcf3c46fdcad688d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380172.940413:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000cdb6afe7/0xcf3c46fdcad688d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380172.940435:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a333557e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867352448:0@lo:101: 00000100:00100000:3.0:1787380172.940500:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380172.940647:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867352448 00000100:00100000:1.0:1787380172.940654:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867352448 00000100:00100000:1.0:1787380172.940707:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787380172.940715:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5fe6b3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+11:6518:x1874203867352448:12345-0@lo:101: 00010000:00010000:1.0:1787380172.940728:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380172.940739:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000065813e61/0xcf3c46fdcad688dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad688d5 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380172.940759:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000065813e61/0xcf3c46fdcad688dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad688d5 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380172.940769:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000065813e61/0xcf3c46fdcad688dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad688d5 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380172.940784:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000065813e61, rc 0) 00000100:00100000:1.0:1787380172.940839:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5fe6b3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:6518:x1874203867352448:12345-0@lo:101: Request processed in 126us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380172.940846:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787380172.940917:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 0000000066d3e139 going to sleep for 11 seconds 00000100:00100000:3.0:1787380172.940937:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a333557e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867352448:0@lo:101: 00010000:00010000:3.0:1787380172.941022:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000cdb6afe7/0xcf3c46fdcad688d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad688dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380172.941031:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000cdb6afe7/0xcf3c46fdcad688d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad688dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380172.941073:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a333557e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867352576:0@lo:256: 00000100:00100000:3.0:1787380172.941101:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380172.944173:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 0000000066d3e139 going to sleep for 11 seconds 00000100:00100000:1.0:1787380172.944611:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867352576 00000100:00100000:1.0:1787380172.944620:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867352576 00000100:00100000:1.0:1787380172.944663:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787380172.944670:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044c9b26b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:6518:x1874203867352576:12345-0@lo:256: 20000000:01000000:1.0:1787380172.944690:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787380172.944703:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787380172.944706:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787380172.944802:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044c9b26b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:6518:x1874203867352576:12345-0@lo:256: Request processed in 132us (3700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380172.944824:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787380172.944865:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a333557e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867352576:0@lo:256: 10000000:01000000:1.0:1787380172.944909:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787380172.944917:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000cdb6afe7/0xcf3c46fdcad688d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad688dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380172.944926:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 00000000cdb6afe7/0xcf3c46fdcad688d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad688dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:0.0:1787380172.952409:0:6952:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787380172.952768:0:6952:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787380173.900110:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380174.476505:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380174.476525:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380174.476527:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eaede43a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867352704:0@lo:400: 00000100:00100000:3.0:1787380174.476541:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e69baa92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867352832:0@lo:400: 00000100:00100000:3.0:1787380174.479995:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380174.480131:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867352832 00000100:00100000:3.0:1787380174.480138:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867352832 00000100:00100000:3.0:1787380174.480175:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787380174.480181:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb929e86 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867352832:12345-0@lo:400: 00000100:00100000:3.0:1787380174.480234:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb929e86 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867352832:12345-0@lo:400: Request processed in 53us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380174.480240:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787380174.480274:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e69baa92 x1874203867352832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380174.480286:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e69baa92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867352832:0@lo:400: 00000100:00100000:1.0:1787380174.487190:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380174.487368:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867352704 00000100:00100000:0.0:1787380174.487378:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867352704 00000100:00100000:0.0:1787380174.487431:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787380174.487440:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036b579cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:3641:x1874203867352704:12345-0@lo:400: 00000100:00100000:0.0:1787380174.487517:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036b579cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:3641:x1874203867352704:12345-0@lo:400: Request processed in 79us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380174.487524:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787380174.487601:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eaede43a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867352704:0@lo:400: 00010000:00010000:0.0:1787380174.932600:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380175.948095:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380176.977232:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380177.996251:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380179.021606:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380179.597026:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380179.597051:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000019479cab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867353088:0@lo:400: 00000100:00100000:0.0:1787380179.597135:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380179.597353:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867353088 00000100:00100000:1.0:1787380179.597361:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867353088 00000100:00100000:1.0:1787380179.597415:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787380179.597424:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009644c398 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867353088:12345-0@lo:400: 00000100:00100000:1.0:1787380179.597480:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009644c398 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867353088:12345-0@lo:400: Request processed in 58us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380179.597488:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787380179.597528:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000019479cab x1874203867353088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380179.597542:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000019479cab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867353088:0@lo:400: 00000100:00100000:3.0:1787380179.597795:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000663ba53e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867352960:0@lo:400: 00000100:00100000:3.0:1787380179.598031:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380179.598077:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867352960 00000100:00100000:3.0:1787380179.598088:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867352960 00000100:00100000:3.0:1787380179.598115:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787380179.598120:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025376c94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:3640:x1874203867352960:12345-0@lo:400: 00000100:00100000:3.0:1787380179.598155:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025376c94 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:3640:x1874203867352960:12345-0@lo:400: Request processed in 35us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380179.598161:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787380179.599212:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000663ba53e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867352960:0@lo:400: 00010000:00010000:0.0:1787380180.045066:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380181.078880:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787380182.092395:0:7451:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787380182.092399:0:7451:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787380182.092401:0:7451:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787380182.092535:0:7451:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000568099bb 00000020:01000004:1.0:1787380182.092565:0:7451:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1787380182.092575:0:7451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787380182.092594:0:7451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000078133008) 00000020:00000080:1.0:1787380182.092609:0:7451:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00010000:00010000:2.0:1787380182.102833:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787380182.192000:0:7451:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1787380182.192067:0:7451:0:(scrub.c:229:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1787380182.232168:0:7451:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787380182.232367:0:7451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1787380182.232376:0:7451:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787380182.232385:0:7451:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf3c46fdcad688ea 00000020:01000004:0.0:1787380182.232391:0:7451:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1787380182.232409:0:7451:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.130@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787380182.232412:0:7451:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787380182.232417:0:7451:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1787380182.232441:0:7451:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1787380182.232445:0:7451:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.130@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1787380182.251915:0:7451:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787380182.251955:0:7451:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.130@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1787380182.251960:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787380182.251961:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787380182.251963:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380182.251964:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380182.251965:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380182.251966:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380182.251967:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787380182.251968:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787380182.251970:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787380182.251971:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380182.251972:0:7451:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787380182.251975:0:7451:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1787380182.251977:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787380182.251979:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787380182.251980:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380182.251981:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380182.251982:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380182.251988:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380182.251989:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787380182.251990:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787380182.251991:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787380182.251992:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380182.251993:0:7451:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787380182.252014:0:7451:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787380182.252030:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e20f03a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867353216:0@lo:253: 00000100:00100000:2.0:1787380182.252090:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380182.252134:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b128c851 going to sleep for 11 seconds 00000100:00100000:0.0:1787380182.253760:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867353216 00000100:00100000:0.0:1787380182.253772:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867353216 00000100:00100000:1.0:1787380182.254515:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787380182.254525:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000426cdd1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:7451:x1874203867353216:12345-0@lo:253: 20000000:01000000:1.0:1787380182.254558:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787380182.254563:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1787380182.254566:0:6513:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1787380182.254569:0:6513:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1787380182.254625:0:6513:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1787380182.254905:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380182.255046:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787380182.255060:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787380182.255075:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1787380182.255088:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1787380182.255098:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1787380182.255148:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1787380182.255156:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1787380182.255167:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1787380182.255172:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1787380182.255181:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1787380182.255185:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1787380182.255194:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1787380182.255205:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1787380182.255284:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1787380182.255304:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.130@tcp (null) (null) (null) 00000040:00080000:1.0:1787380182.255317:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1787380182.255322:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787380182.255332:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1787380182.255336:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.206.130@tcp (null) (null) 00000040:00080000:1.0:1787380182.255345:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1787380182.255349:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787380182.255358:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1787380182.255369:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1787380182.255376:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1787380182.255435:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1787380182.255443:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1787380182.255453:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1787380182.255467:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1787380182.255481:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1787380182.255486:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1787380182.255509:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1787380182.255526:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1787380182.255531:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1787380182.255552:0:6513:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787380182.255557:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1787380182.256579:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1787380182.257183:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787380182.257208:0:6513:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.130@tcp for mdt 20000000:01000000:0.0:1787380182.257210:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.130@tcp (null) (null) (null) 00000040:00080000:0.0:1787380182.257224:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787380182.257231:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787380182.257244:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787380182.257249:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.206.130@tcp (null) (null) 00000040:00080000:0.0:1787380182.257263:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787380182.257271:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1787380182.257283:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1787380182.257356:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1787380182.257409:0:6513:0:(mgs_llog.c:3431:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1787380182.257417:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1787380182.258028:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1787380182.258214:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787380182.258240:0:6513:0:(mgs_llog.c:3489:mgs_write_log_osp_to_mdt()) add nid 192.168.206.130@tcp for mdt 20000000:01000000:0.0:1787380182.258242:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.130@tcp (null) (null) (null) 00000040:00080000:0.0:1787380182.258256:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787380182.258261:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787380182.258272:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787380182.258276:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.206.130@tcp (null) (null) 00000040:00080000:0.0:1787380182.258286:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787380182.258352:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1787380182.258367:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787380182.258380:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1787380182.258396:0:6513:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787380182.258399:0:6513:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787380182.258403:0:6513:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787380182.258447:0:6513:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787380182.258449:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787380182.258793:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1787380182.258924:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1787380182.258941:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787380182.259090:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787380182.259108:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787380182.259131:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787380182.259140:0:6513:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1787380182.259142:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787380182.262035:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787380182.262083:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787380182.262101:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1787380182.262448:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1787380182.262473:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1787380182.262490:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1787380182.262501:0:6513:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787380182.262577:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787380182.263048:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787380182.263067:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787380182.263081:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1787380182.263231:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1787380182.263251:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1787380182.263265:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1787380182.263277:0:6513:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787380182.263279:0:6513:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1787380182.263284:0:6513:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1787380182.263357:0:6513:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787380182.263724:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1787380182.263907:0:6513:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787380182.278150:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787380182.280955:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000847d2d2c/0xcf3c46fdcad688f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.280976:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000aa0b0317/0xcf3c46fdcad68826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6881f expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.280984:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b1169cf6/0xcf3c46fdcad68842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6883b expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.280989:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000575a65a/0xcf3c46fdcad688b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad688ab expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.280994:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000847d2d2c/0xcf3c46fdcad688f1 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.281031:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000575a65a/0xcf3c46fdcad688b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad688ab expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.281044:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000575a65a/0xcf3c46fdcad688b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad688ab expref: 12 pid: 6513 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380182.281056:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eaede43a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1874203867353344:0@lo:104: 00000100:00100000:1.0:1787380182.281130:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787380182.281193:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b1169cf6/0xcf3c46fdcad68842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad6883b expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.281218:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b1169cf6/0xcf3c46fdcad68842 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad6883b expref: 12 pid: 6513 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380182.281226:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c5165389 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1874203867353472:0@lo:104: 00000100:00100000:1.0:1787380182.281249:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787380182.281278:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000aa0b0317/0xcf3c46fdcad68826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad6881f expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.281285:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000aa0b0317/0xcf3c46fdcad68826 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad6881f expref: 12 pid: 6516 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380182.281784:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000095c1d999 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1874203867353600:0@lo:104: 00000100:00100000:1.0:1787380182.281837:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380182.281926:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set 00000000faeb5d27 going to sleep for 11 seconds 00000100:00100000:0.0:1787380182.282002:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867353344 00000100:00100000:0.0:1787380182.282010:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867353344 00000100:00100000:0.0:1787380182.282041:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867353472 00000100:00100000:0.0:1787380182.282044:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867353472 00000100:00100000:0.0:1787380182.282052:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867353600 00000100:00100000:0.0:1787380182.282053:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867353600 00000100:00100000:0.0:1787380182.282063:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787380182.282068:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0374a0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:6513:x1874203867353344:12345-0@lo:104: 00010000:00010000:0.0:1787380182.282079:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: 0000000013d2c87d/0xcf3c46fdcad688ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad688b2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.282135:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787380182.282141:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0374a0a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:6513:x1874203867353344:12345-0@lo:104: Request processed in 72us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380182.282148:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787380182.282165:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787380182.282171:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a92c2b9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:6513:x1874203867353472:12345-0@lo:104: 00010000:00010000:0.0:1787380182.282177:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: 00000000514ad7d4/0xcf3c46fdcad6883b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68842 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.282207:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787380182.282211:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a92c2b9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:6513:x1874203867353472:12345-0@lo:104: Request processed in 41us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380182.282216:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787380182.282227:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787380182.282243:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fb5b9eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:6513:x1874203867353600:12345-0@lo:104: 00010000:00010000:0.0:1787380182.282249:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: 0000000041af641d/0xcf3c46fdcad6881f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68826 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.282275:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787380182.282279:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fb5b9eb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:6513:x1874203867353600:12345-0@lo:104: Request processed in 38us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380182.282284:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787380182.282994:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787380182.283000:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: 0000000013d2c87d/0xcf3c46fdcad688ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad688b2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.283009:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000013d2c87d already unused, calling callback (00000000a6065147) 10000000:00010000:0.0:1787380182.283013:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: 0000000013d2c87d/0xcf3c46fdcad688ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad688b2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.283020:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: 0000000013d2c87d/0xcf3c46fdcad688ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad688b2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380182.283026:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: 0000000013d2c87d/0xcf3c46fdcad688ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad688b2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380182.283032:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787380182.283071:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: 0000000013d2c87d/0xcf3c46fdcad688ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad688b2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.283078:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380182.283091:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: 0000000013d2c87d/0xcf3c46fdcad688ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad688b2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.283109:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: 0000000013d2c87d/0xcf3c46fdcad688ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad688b2 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.283121:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787380182.283123:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: 00000000514ad7d4/0xcf3c46fdcad6883b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68842 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.283129:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000514ad7d4 already unused, calling callback (00000000a6065147) 10000000:00010000:0.0:1787380182.283131:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: 00000000514ad7d4/0xcf3c46fdcad6883b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68842 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.283137:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: 00000000514ad7d4/0xcf3c46fdcad6883b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68842 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380182.283142:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: 00000000514ad7d4/0xcf3c46fdcad6883b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68842 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380182.283146:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787380182.283160:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: 00000000514ad7d4/0xcf3c46fdcad6883b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68842 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.283166:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380182.283177:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: 00000000514ad7d4/0xcf3c46fdcad6883b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68842 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.283183:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: 00000000514ad7d4/0xcf3c46fdcad6883b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68842 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.283192:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380182.283199:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: 0000000041af641d/0xcf3c46fdcad6881f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68826 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.283204:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000041af641d already unused, calling callback (00000000a6065147) 10000000:00010000:0.0:1787380182.283206:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: 0000000041af641d/0xcf3c46fdcad6881f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68826 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.283212:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: 0000000041af641d/0xcf3c46fdcad6881f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68826 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380182.283217:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: 0000000041af641d/0xcf3c46fdcad6881f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68826 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380182.283221:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787380182.283233:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: 0000000041af641d/0xcf3c46fdcad6881f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68826 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.283238:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380182.283243:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: 0000000041af641d/0xcf3c46fdcad6881f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68826 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.283248:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: 0000000041af641d/0xcf3c46fdcad6881f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68826 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.283260:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380182.283262:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380182.283264:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380182.283385:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000de1d6cba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867353728:0@lo:103: 00000100:00100000:1.0:1787380182.283425:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380182.283479:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000aa10042 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867353984:0@lo:103: 00000100:00100000:1.0:1787380182.283500:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380182.283533:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380182.283538:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000041b33fc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867353856:0@lo:103: 00000100:00100000:1.0:1787380182.283557:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380182.283585:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867353728 00000100:00100000:1.0:1787380182.283591:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867353728 00010000:00010000:1.0:1787380182.283612:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000575a65a/0xcf3c46fdcad688b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad688ab expref: 13 pid: 6513 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380182.283628:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867353984 00000100:00100000:1.0:1787380182.283637:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867353984 00000100:00100000:3.0:1787380182.283787:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867353856 00000100:00100000:3.0:1787380182.283792:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867353856 00010000:00010000:3.0:1787380182.283831:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b1169cf6/0xcf3c46fdcad68842 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6883b expref: 15 pid: 6513 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380182.283848:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787380182.283855:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ed46b9c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:3642:x1874203867353728:12345-0@lo:103: 00010000:00010000:3.0:1787380182.283866:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380182.283871:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000575a65a/0xcf3c46fdcad688b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad688ab expref: 15 pid: 6513 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.283879:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000575a65a/0xcf3c46fdcad688b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad688ab expref: 15 pid: 6513 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.283910:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380182.283940:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ed46b9c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:3642:x1874203867353728:12345-0@lo:103: Request processed in 87us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380182.283947:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787380182.283962:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380182.283968:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000de9b5db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:3640:x1874203867353856:12345-0@lo:103: 00010000:00010000:3.0:1787380182.283974:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380182.283977:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b1169cf6/0xcf3c46fdcad68842 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6883b expref: 14 pid: 6513 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.283984:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b1169cf6/0xcf3c46fdcad68842 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad6883b expref: 14 pid: 6513 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.283992:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380182.284014:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000de9b5db pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:3640:x1874203867353856:12345-0@lo:103: Request processed in 48us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380182.284020:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380182.284050:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000de1d6cba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867353728:0@lo:103: 00000100:00100000:3.0:1787380182.284072:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000041b33fc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867353856:0@lo:103: 00010000:00010000:1.0:1787380182.284122:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000aa0b0317/0xcf3c46fdcad68826 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6881f expref: 13 pid: 6516 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380182.284146:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787380182.284152:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007831e31e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+13:3640:x1874203867353984:12345-0@lo:103: 00010000:00010000:1.0:1787380182.284160:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380182.284162:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000aa0b0317/0xcf3c46fdcad68826 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6881f expref: 13 pid: 6516 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.284170:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000aa0b0317/0xcf3c46fdcad68826 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad6881f expref: 13 pid: 6516 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.284181:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000847d2d2c/0xcf3c46fdcad688f1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.284188:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000847d2d2c/0xcf3c46fdcad688f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.284201:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000847d2d2c/0xcf3c46fdcad688f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.284207:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000847d2d2c/0xcf3c46fdcad688f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.284212:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000847d2d2c/0xcf3c46fdcad688f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.284217:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000847d2d2c/0xcf3c46fdcad688f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.284222:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000847d2d2c already unused, calling callback (00000000e476b6df) 00010000:00010000:1.0:1787380182.284230:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000847d2d2c/0xcf3c46fdcad688f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.284237:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000847d2d2c/0xcf3c46fdcad688f1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.284244:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000847d2d2c/0xcf3c46fdcad688f1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.284254:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380182.284278:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007831e31e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+13:3640:x1874203867353984:12345-0@lo:103: Request processed in 127us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380182.284284:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787380182.284310:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000575a65a/0xcf3c46fdcad688b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad688ab expref: 12 pid: 6513 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380182.284320:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eaede43a pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1874203867353344:0@lo:104: 00010000:00010000:1.0:1787380182.284327:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b1169cf6/0xcf3c46fdcad68842 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad6883b expref: 11 pid: 6513 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380182.284333:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c5165389 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1874203867353472:0@lo:104: 00010000:00010000:1.0:1787380182.284339:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000aa0b0317/0xcf3c46fdcad68826 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad6881f expref: 10 pid: 6516 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380182.284346:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000095c1d999 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1874203867353600:0@lo:104: 00010000:00010000:1.0:1787380182.284360:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000847d2d2c/0xcf3c46fdcad688f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.284367:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000847d2d2c/0xcf3c46fdcad688f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.284381:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000847d2d2c/0xcf3c46fdcad688f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.284386:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000847d2d2c/0xcf3c46fdcad688f1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787380182.284399:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787380182.284588:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000aa10042 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867353984:0@lo:103: 00010000:00010000:3.0:1787380182.284850:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380182.286697:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000426cdd1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+9:7451:x1874203867353216:12345-0@lo:253: Request processed in 32166us (34600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380182.286711:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787380182.287215:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e20f03a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867353216:0@lo:253: 10000000:01000000:2.0:1787380182.287230:0:7451:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787380182.287232:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787380182.287234:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787380182.287235:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380182.287237:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:2.0:1787380182.287238:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380182.287239:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380182.287240:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787380182.287242:0:7451:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787380182.287243:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380182.287245:0:7451:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787380182.287286:0:7451:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000568099bb from lustre-MDT0001 10000000:01000000:2.0:1787380182.287321:0:7451:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787380182.287324:0:7451:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787380182.287330:0:7451:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d6ff8828000 local copy 10000000:01000000:2.0:1787380182.287334:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787380182.287365:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000d0135df0/0xcf3c46fdcad688f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.287375:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.130@tcp lock: 00000000d0135df0/0xcf3c46fdcad688f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.287384:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000d0135df0/0xcf3c46fdcad688f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380182.287416:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e20f03a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867354112:0@lo:101: 00000100:00100000:2.0:1787380182.287456:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380182.287541:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000047570ee1 going to sleep for 11 seconds 00000100:00100000:0.0:1787380182.288034:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867354112 00000100:00100000:0.0:1787380182.288042:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867354112 00000100:00100000:2.0:1787380182.288135:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787380182.288142:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efa761e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+9:7451:x1874203867354112:12345-0@lo:101: 00010000:00010000:2.0:1787380182.288154:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380182.288168:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006208d2f7/0xcf3c46fdcad688ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad688f8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.288188:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006208d2f7/0xcf3c46fdcad688ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad688f8 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.288197:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006208d2f7/0xcf3c46fdcad688ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad688f8 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.288205:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006208d2f7, rc 0) 00000100:00100000:2.0:1787380182.288250:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efa761e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+10:7451:x1874203867354112:12345-0@lo:101: Request processed in 109us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380182.288256:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787380182.288416:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e20f03a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867354112:0@lo:101: 00010000:00010000:0.0:1787380182.288428:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000d0135df0/0xcf3c46fdcad688f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcf3c46fdcad688ff expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.288447:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000d0135df0/0xcf3c46fdcad688f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf3c46fdcad688ff expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380182.288545:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006b69e559 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867354240:0@lo:501: 00000100:00100000:0.0:1787380182.288576:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380182.288604:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000007c33cc05 going to sleep for 11 seconds 00000100:00100000:1.0:1787380182.288654:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867354240 00000100:00100000:1.0:1787380182.288659:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867354240 00000100:00100000:1.0:1787380182.288690:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787380182.288696:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000deaf5639 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+10:7451:x1874203867354240:12345-0@lo:501: 00000100:00100000:1.0:1787380182.288755:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000deaf5639 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+10:7451:x1874203867354240:12345-0@lo:501: Request processed in 59us (179us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787380182.288762:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787380182.288927:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006b69e559 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867354240:0@lo:501: 10000000:01000000:0.0:1787380182.288942:0:7451:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787380182.288958:0:7451:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787380182.288961:0:7451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000d0135df0/0xcf3c46fdcad688f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf3c46fdcad688ff expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.288969:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000d0135df0/0xcf3c46fdcad688f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf3c46fdcad688ff expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.288975:0:7451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: 00000000d0135df0/0xcf3c46fdcad688f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf3c46fdcad688ff expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.288998:0:7451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787380182.289018:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d6ff3dad800 10000000:01000000:0.0:1787380182.289022:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787380182.289026:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9d6ff8828000 10000000:01000000:0.0:1787380182.289028:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787380182.289031:0:7451:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9d6ff8828000 from 1 10000000:01000000:0.0:1787380182.289033:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787380182.289050:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 000000007e159999/0xcf3c46fdcad68906 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.289067:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 000000007e159999/0xcf3c46fdcad68906 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.289073:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 000000007e159999/0xcf3c46fdcad68906 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380182.289085:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006b69e559 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867354368:0@lo:101: 00000100:00100000:0.0:1787380182.289110:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380182.289122:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007e1acf1 going to sleep for 11 seconds 00000100:00100000:1.0:1787380182.289169:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867354368 00000100:00100000:1.0:1787380182.289174:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867354368 00000100:00100000:1.0:1787380182.289203:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787380182.289209:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070f0cb83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+10:7451:x1874203867354368:12345-0@lo:101: 00010000:00010000:1.0:1787380182.289216:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380182.289226:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b95db6de/0xcf3c46fdcad6890d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68906 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.289240:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b95db6de/0xcf3c46fdcad6890d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68906 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.289259:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b95db6de/0xcf3c46fdcad6890d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68906 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.289275:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b95db6de, rc 0) 00000100:00100000:1.0:1787380182.289384:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070f0cb83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+11:7451:x1874203867354368:12345-0@lo:101: Request processed in 176us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380182.289391:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1787380182.289411:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380182.289416:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: 00000000d0135df0/0xcf3c46fdcad688f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcf3c46fdcad688ff expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.289423:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d0135df0 already unused, calling callback (00000000a6065147) 10000000:00010000:1.0:1787380182.289425:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: 00000000d0135df0/0xcf3c46fdcad688f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcf3c46fdcad688ff expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.289432:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: 00000000d0135df0/0xcf3c46fdcad688f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xcf3c46fdcad688ff expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380182.289438:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: 00000000d0135df0/0xcf3c46fdcad688f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xcf3c46fdcad688ff expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380182.289444:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787380182.289458:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: 00000000d0135df0/0xcf3c46fdcad688f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf3c46fdcad688ff expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.289464:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380182.289486:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: 00000000d0135df0/0xcf3c46fdcad688f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf3c46fdcad688ff expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.289502:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: 00000000d0135df0/0xcf3c46fdcad688f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf3c46fdcad688ff expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.289517:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380182.289518:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380182.289520:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380182.289529:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000095c1d999 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867354496:0@lo:103: 00000100:00100000:1.0:1787380182.289553:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380182.289579:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867354496 00000100:00100000:1.0:1787380182.289583:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867354496 00000100:00100000:1.0:1787380182.289607:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380182.289612:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5165389 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+11:3641:x1874203867354496:12345-0@lo:103: 00010000:00010000:1.0:1787380182.289620:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380182.289629:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006208d2f7/0xcf3c46fdcad688ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad688f8 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.289641:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380182.289677:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5165389 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+10:3641:x1874203867354496:12345-0@lo:103: Request processed in 65us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380182.289684:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380182.289705:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000095c1d999 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867354496:0@lo:103: 00000100:00100000:0.0:1787380182.289838:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006b69e559 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867354368:0@lo:101: 00010000:00010000:0.0:1787380182.289849:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 000000007e159999/0xcf3c46fdcad68906 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6890d expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.289856:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 000000007e159999/0xcf3c46fdcad68906 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad6890d expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380182.289872:0:7451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787380182.289882:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 000000007e159999/0xcf3c46fdcad68906 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6890d expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.289890:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 000000007e159999/0xcf3c46fdcad68906 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6890d expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380182.289908:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d6ff3dad800 10000000:01000000:0.0:1787380182.289911:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787380182.289914:0:7451:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9d6ff3dad800 from 1 10000000:01000000:0.0:1787380182.289916:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787380182.289928:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000e8cd1c3d/0xcf3c46fdcad68914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.289940:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000e8cd1c3d/0xcf3c46fdcad68914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.289947:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000e8cd1c3d/0xcf3c46fdcad68914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380182.289958:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006b69e559 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867354624:0@lo:101: 00000100:00100000:0.0:1787380182.289981:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380182.289991:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007e1acf1 going to sleep for 11 seconds 00000100:00100000:2.0:1787380182.290123:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867354624 00000100:00100000:2.0:1787380182.290128:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867354624 00000100:00100000:2.0:1787380182.290158:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787380182.290164:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000293d43a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+10:7451:x1874203867354624:12345-0@lo:101: 00010000:00010000:2.0:1787380182.290172:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380182.290180:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009092e755/0xcf3c46fdcad6891b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68914 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.290205:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009092e755/0xcf3c46fdcad6891b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68914 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.290213:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009092e755/0xcf3c46fdcad6891b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68914 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.290219:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009092e755, rc 0) 00000100:00100000:2.0:1787380182.290245:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000293d43a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+11:7451:x1874203867354624:12345-0@lo:101: Request processed in 82us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380182.290251:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787380182.290328:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006b69e559 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867354624:0@lo:101: 00010000:00010000:0.0:1787380182.290337:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000e8cd1c3d/0xcf3c46fdcad68914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6891b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.290344:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000e8cd1c3d/0xcf3c46fdcad68914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad6891b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380182.290354:0:7451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787380182.290357:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000e8cd1c3d/0xcf3c46fdcad68914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6891b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.290363:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 00000000e8cd1c3d/0xcf3c46fdcad68914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6891b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380182.290369:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1787380182.290373:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787380182.290376:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d6ff3dad800 10000000:01000000:0.0:1787380182.290379:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787380182.290382:0:7451:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1787380182.290389:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1787380182.290403:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000a43c0b6e/0xcf3c46fdcad68922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.290409:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000a43c0b6e/0xcf3c46fdcad68922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.290415:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000a43c0b6e/0xcf3c46fdcad68922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380182.290426:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006b69e559 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867354752:0@lo:101: 00000100:00100000:0.0:1787380182.290448:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380182.290477:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007e1acf1 going to sleep for 11 seconds 00000100:00100000:2.0:1787380182.290629:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867354752 00000100:00100000:2.0:1787380182.290633:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867354752 00000100:00100000:2.0:1787380182.290667:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787380182.290673:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007759dae2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+11:7451:x1874203867354752:12345-0@lo:101: 00010000:00010000:2.0:1787380182.290680:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380182.290700:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006053c1ac/0xcf3c46fdcad68929 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68922 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.290713:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006053c1ac/0xcf3c46fdcad68929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68922 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.290720:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006053c1ac/0xcf3c46fdcad68929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68922 expref: 12 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.290727:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006053c1ac, rc 0) 00000100:00100000:2.0:1787380182.290751:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007759dae2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:7451:x1874203867354752:12345-0@lo:101: Request processed in 79us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380182.290757:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787380182.290912:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006b69e559 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867354752:0@lo:101: 00010000:00010000:0.0:1787380182.290921:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000a43c0b6e/0xcf3c46fdcad68922 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68929 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.290927:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000a43c0b6e/0xcf3c46fdcad68922 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68929 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380182.291003:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006b69e559 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867354880:0@lo:501: 00000100:00100000:0.0:1787380182.291028:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380182.291040:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007e1acf1 going to sleep for 11 seconds 00000100:00100000:1.0:1787380182.291108:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867354880 00000100:00100000:1.0:1787380182.291112:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867354880 00000100:00100000:1.0:1787380182.291140:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787380182.291147:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024d36a23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:7451:x1874203867354880:12345-0@lo:501: 00000100:00100000:1.0:1787380182.291232:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024d36a23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:7451:x1874203867354880:12345-0@lo:501: Request processed in 86us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380182.291245:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787380182.291319:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006b69e559 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867354880:0@lo:501: 00000100:00100000:0.0:1787380182.291354:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006b69e559 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867355008:0@lo:503: 00000100:00100000:0.0:1787380182.291388:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380182.291408:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007e1acf1 going to sleep for 11 seconds 00000100:00100000:1.0:1787380182.291445:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867355008 00000100:00100000:1.0:1787380182.291449:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867355008 00000100:00100000:1.0:1787380182.291474:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787380182.291479:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f44ac45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:7451:x1874203867355008:12345-0@lo:503: 00000100:00100000:1.0:1787380182.291559:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f44ac45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:7451:x1874203867355008:12345-0@lo:503: Request processed in 79us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380182.291565:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787380182.291984:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006b69e559 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867355008:0@lo:503: 00000040:00080000:0.0:1787380182.292260:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787380182.292350:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006b69e559 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867355136:0@lo:502: 00000100:00100000:0.0:1787380182.292389:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380182.292411:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000007e1acf1 going to sleep for 11 seconds 00000100:00100000:2.0:1787380182.292467:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867355136 00000100:00100000:2.0:1787380182.292472:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867355136 00000100:00100000:2.0:1787380182.292514:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787380182.292520:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000056415af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:7451:x1874203867355136:12345-0@lo:502: 00000100:00100000:2.0:1787380182.292610:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000056415af1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:7451:x1874203867355136:12345-0@lo:502: Request processed in 90us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380182.292617:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787380182.292776:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006b69e559 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867355136:0@lo:502: 00000040:00080000:2.0:1787380182.293018:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787380182.293043:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1787380182.293056:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1787380182.293066:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1787380182.293089:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1787380182.293102:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1787380182.293114:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1787380182.293127:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1787380182.293140:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1787380182.293152:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1787380182.293162:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1787380182.293172:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1787380182.293183:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1787380182.293194:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1787380182.293207:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1787380182.293221:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1787380182.293231:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1787380182.293242:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1787380182.293253:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1787380182.293264:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1787380182.293289:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1787380182.293305:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1787380182.293317:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1787380182.293346:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d58351da pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867355264:0@lo:502: 00000100:00100000:2.0:1787380182.293385:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380182.293405:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000001afa68d9 going to sleep for 11 seconds 00000100:00100000:2.0:1787380182.293424:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867355264 00000100:00100000:2.0:1787380182.293429:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867355264 00000100:00100000:2.0:1787380182.293456:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787380182.293461:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065384930 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:7451:x1874203867355264:12345-0@lo:502: 00000100:00100000:2.0:1787380182.293791:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065384930 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:7451:x1874203867355264:12345-0@lo:502: Request processed in 330us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380182.293799:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787380182.294025:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d58351da pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867355264:0@lo:502: 00000040:00080000:0.0:1787380182.294074:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1787380182.294082:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1787380182.294531:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380182.294542:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380182.294544:0:7463:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787380182.294548:0:7463:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1787380182.294551:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787380182.294571:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000063b9d39f) 00000020:00000080:0.0:1787380182.294590:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1787380182.294596:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787380182.294796:0:7463:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787380182.294803:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf3c46fdcad68937 00000020:00000080:1.0:1787380182.295341:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1787380182.295346:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380182.295350:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380182.295351:0:7463:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1787380182.295354:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380182.295358:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380182.295359:0:7463:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1787380182.295363:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787380182.295370:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000b3519583) 00000020:00000080:1.0:1787380182.295382:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1787380182.295387:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787380182.295389:0:7463:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1787380182.295392:0:7463:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1787380182.295397:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787380182.295464:0:7463:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000568099bb from lustre-MDT0001, refs=2 00000020:00000080:1.0:1787380182.295477:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000fcfad3a9) 00000020:00000080:1.0:1787380182.295485:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1787380182.295561:0:7463:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787380182.295567:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3c46fdcad6894c 00000020:00000080:1.0:1787380182.295659:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1787380182.295665:0:7463:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787380182.295669:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xcf3c46fdcad68953 00080000:01000000:1.0:1787380182.295678:0:7463:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787380182.295681:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf3c46fdcad6895a 00080000:10000000:1.0:1787380182.296162:0:7463:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1787380182.296279:0:7463:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1787380182.406924:0:7463:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1787380182.407184:0:7463:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1787380182.411126:0:7463:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1787380182.411437:0:7463:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787380182.430959:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1787380182.430977:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380182.430985:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380182.430987:0:7463:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1787380182.430991:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380182.430997:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380182.430998:0:7463:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1787380182.431001:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787380182.431006:0:7463:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.130@tcp to nid 0x20000c0a8ce82 (192.168.206.130@tcp) 00000020:00000080:1.0:1787380182.431033:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787380182.431049:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000bc69dce6) 00000020:00000080:1.0:1787380182.431068:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787380182.431072:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787380182.431155:0:7463:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1787380182.431162:0:7463:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787380182.431168:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf3c46fdcad68968 00010000:00080000:1.0:1787380182.431198:0:7463:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000011e85d4f@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.130@tcp at head 00010000:00010000:1.0:1787380182.436264:0:7463:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1787380182.442239:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787380182.442254:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787380182.442371:0:7463:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787380182.442392:0:7463:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3c46fdcad6896f 00000100:00080000:1.0:1787380182.442402:0:7463:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787380182.442407:0:7463:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000011e85d4f using connection 192.168.206.130@tcp/0@lo 00000100:00100000:1.0:1787380182.442440:0:7463:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000095c1d999 x1874203867355392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787380182.442496:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000095c1d999 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867355392:0@lo:38: 00000100:00100000:3.0:1787380182.442564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380182.442661:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867355392 00000100:00100000:2.0:1787380182.442668:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867355392 00000100:00100000:2.0:1787380182.442703:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380182.442709:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ada8304 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1874203867355392:12345-0@lo:38: 00010000:00080000:2.0:1787380182.442729:0:6526:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:2.0:1787380182.442758:0:6526:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3c46fdcad68976 00000004:00100000:2.0:1787380182.442770:0:6526:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787380182.442774:0:6526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1787380182.443045:0:7463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1787380182.443113:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380182.443118:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380182.443119:0:7463:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1787380182.443122:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787380182.443125:0:7463:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787380182.443126:0:7463:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787380182.443128:0:7463:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787380182.443129:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787380182.443131:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380182.443132:0:7463:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787380182.443134:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380182.443138:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380182.443139:0:7463:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1787380182.443142:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787380182.443175:0:7463:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787380182.443188:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380182.443191:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380182.443192:0:7463:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1787380182.443195:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380182.443197:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380182.443198:0:7463:0:(obd_config.c:1561:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787380182.443201:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787380182.443202:0:7463:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787380182.443222:0:7463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380182.443226:0:7463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380182.443227:0:7463:0:(obd_config.c:1561:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787380182.443229:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:2.0:1787380182.443404:0:7451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1787380182.443428:0:7451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787380182.443440:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000a43c0b6e/0xcf3c46fdcad68922 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68929 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.443451:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 00000000a43c0b6e/0xcf3c46fdcad68922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68929 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380182.443458:0:7451:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6ff3dad800 from 1 10000000:01000000:2.0:1787380182.443461:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787380182.443487:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 0000000068ef8694/0xcf3c46fdcad6897d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.443493:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 0000000068ef8694/0xcf3c46fdcad6897d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.443501:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 0000000068ef8694/0xcf3c46fdcad6897d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380182.443514:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000020b923ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867355648:0@lo:101: 00000100:00100000:2.0:1787380182.443550:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380182.443571:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b1610549 going to sleep for 11 seconds 00000100:00100000:2.0:1787380182.443587:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002fd6e943 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867355520:0@lo:400: 00000100:00100000:2.0:1787380182.443612:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380182.443657:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867355520 00000100:00100000:2.0:1787380182.443661:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867355520 00000100:00100000:2.0:1787380182.443689:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787380182.443695:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024d5ee24 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867355520:12345-0@lo:400: 00000100:00100000:2.0:1787380182.443739:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024d5ee24 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867355520:12345-0@lo:400: Request processed in 45us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380182.443746:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787380182.443778:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002fd6e943 x1874203867355520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380182.443790:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002fd6e943 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867355520:0@lo:400: 00000100:00100000:2.0:1787380182.443859:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867355648 00000100:00100000:2.0:1787380182.443863:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867355648 00000100:00100000:2.0:1787380182.443884:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787380182.443889:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009dcfa4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+12:7451:x1874203867355648:12345-0@lo:101: 00010000:00010000:2.0:1787380182.443913:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380182.443923:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f06130ef/0xcf3c46fdcad68984 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6897d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.443942:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f06130ef/0xcf3c46fdcad68984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6897d expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.443950:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f06130ef/0xcf3c46fdcad68984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6897d expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.443957:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f06130ef, rc 0) 00000100:00100000:2.0:1787380182.443980:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009dcfa4ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+13:7451:x1874203867355648:12345-0@lo:101: Request processed in 91us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380182.443985:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787380182.444015:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000020b923ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867355648:0@lo:101: 00010000:00010000:2.0:1787380182.444024:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 0000000068ef8694/0xcf3c46fdcad6897d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68984 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.444031:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 0000000068ef8694/0xcf3c46fdcad6897d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68984 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380182.444564:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000020b923ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867355776:0@lo:256: 00000100:00100000:2.0:1787380182.444600:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380182.444616:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b1610549 going to sleep for 11 seconds 00000100:00100000:2.0:1787380182.444633:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867355776 00000100:00100000:2.0:1787380182.444636:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867355776 00000100:00100000:2.0:1787380182.444655:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787380182.444660:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f348e64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+13:7451:x1874203867355776:12345-0@lo:256: 20000000:01000000:2.0:1787380182.445297:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787380182.445312:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787380182.445315:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787380182.445386:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f348e64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+13:7451:x1874203867355776:12345-0@lo:256: Request processed in 726us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380182.445393:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787380182.445433:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000020b923ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867355776:0@lo:256: 10000000:01000000:2.0:1787380182.445967:0:7451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787380182.445979:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 0000000068ef8694/0xcf3c46fdcad6897d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68984 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.445988:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 0000000068ef8694/0xcf3c46fdcad6897d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68984 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380182.445995:0:7451:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ff3dad800 from 1 10000000:01000000:2.0:1787380182.445997:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787380182.446017:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000b51d605c/0xcf3c46fdcad6898b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.446023:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000b51d605c/0xcf3c46fdcad6898b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.446030:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000b51d605c/0xcf3c46fdcad6898b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380182.446042:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000020b923ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867355904:0@lo:101: 00000100:00100000:2.0:1787380182.446069:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380182.446081:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b1610549 going to sleep for 11 seconds 00000100:00100000:2.0:1787380182.446105:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867355904 00000100:00100000:2.0:1787380182.446115:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867355904 00000100:00100000:2.0:1787380182.446141:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787380182.446147:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b33a8916 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+13:7451:x1874203867355904:12345-0@lo:101: 00010000:00010000:2.0:1787380182.446154:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380182.446162:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a0e8b5da/0xcf3c46fdcad68992 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6898b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.446179:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a0e8b5da/0xcf3c46fdcad68992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6898b expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.446187:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a0e8b5da/0xcf3c46fdcad68992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6898b expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.446194:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a0e8b5da, rc 0) 00000100:00100000:2.0:1787380182.449488:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b33a8916 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:7451:x1874203867355904:12345-0@lo:101: Request processed in 3333us (3410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380182.449501:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787380182.449594:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000020b923ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867355904:0@lo:101: 00010000:00010000:2.0:1787380182.449616:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000b51d605c/0xcf3c46fdcad6898b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68992 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.449629:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000b51d605c/0xcf3c46fdcad6898b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68992 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380182.450174:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000020b923ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867356032:0@lo:501: 00000100:00100000:2.0:1787380182.450224:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380182.450253:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b1610549 going to sleep for 11 seconds 00000100:00100000:2.0:1787380182.450271:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867356032 00000100:00100000:2.0:1787380182.450277:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867356032 00000100:00100000:2.0:1787380182.450397:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787380182.450404:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c78c82c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:7451:x1874203867356032:12345-0@lo:501: 00000100:00100000:2.0:1787380182.450498:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c78c82c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:7451:x1874203867356032:12345-0@lo:501: Request processed in 94us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380182.450504:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787380182.450529:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000020b923ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867356032:0@lo:501: 00000100:00100000:2.0:1787380182.450551:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000020b923ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867356160:0@lo:503: 00000100:00100000:2.0:1787380182.450582:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380182.450593:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b1610549 going to sleep for 11 seconds 00000100:00100000:2.0:1787380182.450604:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867356160 00000100:00100000:2.0:1787380182.450607:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867356160 00000100:00100000:2.0:1787380182.450624:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787380182.450628:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000092fb01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:7451:x1874203867356160:12345-0@lo:503: 00000040:00080000:2.0:1787380182.450666:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787380182.450701:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000092fb01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:7451:x1874203867356160:12345-0@lo:503: Request processed in 73us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380182.450708:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787380182.450741:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000020b923ce pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867356160:0@lo:503: 00000040:00080000:2.0:1787380182.450979:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787380182.451033:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1787380182.451086:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1787380182.459189:0:6526:0:(import.c:65:import_set_state_nolock()) 00000000a9ae34e4 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787380182.459277:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ada8304 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1874203867355392:12345-0@lo:38: Request processed in 16565us (16712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380182.459288:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787380182.459376:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787380182.459386:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1787380182.459396:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787380182.459402:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787380182.459406:0:3638:0:(import.c:65:import_set_state_nolock()) 0000000011e85d4f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787380182.459423:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000095c1d999 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867355392:0@lo:38: 00000100:00100000:0.0:1787380182.459559:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000020b923ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867356288:0@lo:41: 00000100:00100000:0.0:1787380182.459602:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380182.459777:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867356288 00000100:00100000:2.0:1787380182.459784:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867356288 00000100:00100000:2.0:1787380182.459856:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787380182.459864:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000737abe08 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1874203867356288:12345-0@lo:41: 00000004:00000024:2.0:1787380182.459888:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1787380182.459939:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000737abe08 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3639:x1874203867356288:12345-0@lo:41: Request processed in 76us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380182.459945:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787380182.460015:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000020b923ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867356288:0@lo:41: 00000040:00080000:2.0:1787380182.461448:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1787380182.463239:0:7451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1787380182.463284:0:7451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787380182.463314:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000b51d605c/0xcf3c46fdcad6898b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68992 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.463342:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 00000000b51d605c/0xcf3c46fdcad6898b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68992 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380182.463402:0:7451:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787380182.463405:0:7451:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d6ff3dad800 10000000:01000000:3.0:1787380182.463408:0:7451:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d6ff3dad800 10000000:01000000:3.0:1787380182.463413:0:7451:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787380182.463419:0:7451:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6ff3dad800 from 1 10000000:01000000:3.0:1787380182.463422:0:7451:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787380182.463459:0:7451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000d67a4aeb/0xcf3c46fdcad68999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.463467:0:7451:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000d67a4aeb/0xcf3c46fdcad68999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.463476:0:7451:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000d67a4aeb/0xcf3c46fdcad68999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380182.463499:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000057be9c2a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867356416:0@lo:101: 00000100:00100000:3.0:1787380182.463569:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380182.463619:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bf8774a4 going to sleep for 11 seconds 00000100:00100000:0.0:1787380182.463998:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867356416 00000100:00100000:0.0:1787380182.464005:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867356416 00000100:00100000:0.0:1787380182.464061:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787380182.464069:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbfaccf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:7451:x1874203867356416:12345-0@lo:101: 00010000:00010000:0.0:1787380182.464084:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380182.464096:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000186ed416/0xcf3c46fdcad689a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68999 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.464118:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000186ed416/0xcf3c46fdcad689a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68999 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.464127:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000186ed416/0xcf3c46fdcad689a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68999 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380182.464135:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000186ed416, rc 0) 00000100:00100000:0.0:1787380182.464423:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbfaccf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:7451:x1874203867356416:12345-0@lo:101: Request processed in 353us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380182.464430:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787380182.468180:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000057be9c2a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867356416:0@lo:101: 00010000:00010000:1.0:1787380182.468207:0:7451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000d67a4aeb/0xcf3c46fdcad68999 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad689a0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.468240:0:7451:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000d67a4aeb/0xcf3c46fdcad68999 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad689a0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380182.468638:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eaede43a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867356544:0@lo:501: 00000100:00100000:1.0:1787380182.468770:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380182.468929:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000079318a6b going to sleep for 11 seconds 00000100:00100000:3.0:1787380182.468991:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867356544 00000100:00100000:3.0:1787380182.468998:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867356544 00000100:00100000:3.0:1787380182.469085:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787380182.469094:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a238b4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:7451:x1874203867356544:12345-0@lo:501: 00000100:00100000:3.0:1787380182.469211:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a238b4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:7451:x1874203867356544:12345-0@lo:501: Request processed in 117us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380182.469219:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787380182.469307:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eaede43a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867356544:0@lo:501: 00000100:00100000:1.0:1787380182.469334:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eaede43a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867356672:0@lo:503: 00000100:00100000:1.0:1787380182.469372:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380182.469663:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000079318a6b going to sleep for 11 seconds 00000100:00100000:0.0:1787380182.469838:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867356672 00000100:00100000:0.0:1787380182.469845:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867356672 00000100:00100000:0.0:1787380182.469872:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787380182.469878:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8de8052 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:7451:x1874203867356672:12345-0@lo:503: 00000100:00100000:0.0:1787380182.469979:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8de8052 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:7451:x1874203867356672:12345-0@lo:503: Request processed in 101us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380182.469985:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787380182.470132:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eaede43a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867356672:0@lo:503: 00000040:00080000:1.0:1787380182.470505:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787380182.470583:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eaede43a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867356800:0@lo:502: 00000100:00100000:1.0:1787380182.470622:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380182.470661:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000079318a6b going to sleep for 11 seconds 00000100:00100000:1.0:1787380182.470676:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867356800 00000100:00100000:1.0:1787380182.470680:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867356800 00000100:00100000:1.0:1787380182.470700:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787380182.470706:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2286c81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:7451:x1874203867356800:12345-0@lo:502: 00000100:00100000:1.0:1787380182.470781:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2286c81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:7451:x1874203867356800:12345-0@lo:502: Request processed in 75us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380182.470788:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787380182.470840:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eaede43a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867356800:0@lo:502: 00000040:00080000:1.0:1787380182.471001:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787380182.471031:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787380182.471045:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787380182.471057:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787380182.471068:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787380182.471079:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787380182.471090:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787380182.471103:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787380182.471116:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787380182.471128:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787380182.471153:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787380182.471167:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787380182.471180:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787380182.471192:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787380182.471204:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787380182.471216:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787380182.471228:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787380182.471239:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787380182.471250:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787380182.471263:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787380182.471274:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787380182.471285:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787380182.471550:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787380182.471565:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787380182.471577:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787380182.471589:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787380182.471617:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787380182.471632:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1787380182.471716:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eaede43a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867356928:0@lo:502: 00000100:00100000:1.0:1787380182.471765:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380182.471791:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 0000000079318a6b going to sleep for 11 seconds 00000100:00100000:1.0:1787380182.471832:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867356928 00000100:00100000:1.0:1787380182.471837:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867356928 00000100:00100000:1.0:1787380182.471872:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787380182.471878:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b7d6dfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:7451:x1874203867356928:12345-0@lo:502: 00000100:00100000:1.0:1787380182.471973:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b7d6dfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:7451:x1874203867356928:12345-0@lo:502: Request processed in 95us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380182.471980:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787380182.472025:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eaede43a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867356928:0@lo:502: 00000040:00080000:1.0:1787380182.472062:0:7451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787380182.472069:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787380182.472746:0:7469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1787380182.472768:0:7469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (0000000016bff309) 00000020:00000080:1.0:1787380182.472789:0:7469:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787380182.472982:0:7469:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000568099bb from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787380182.472986:0:7469:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000568099bb from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787380182.472988:0:7469:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000568099bb 3 00010000:00080000:1.0:1787380182.473021:0:7469:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006eee2b7d@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.130@tcp at head 00010000:00010000:1.0:1787380182.479316:0:7469:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1787380182.479423:0:7469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1787380182.479465:0:7469:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787380182.479476:0:7469:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xcf3c46fdcad689ae 00000100:00080000:1.0:1787380182.479486:0:7469:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787380182.479491:0:7469:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000006eee2b7d using connection 192.168.206.130@tcp/0@lo 00000100:00100000:1.0:1787380182.479522:0:7469:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000eaede43a x1874203867357056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787380182.479555:0:7469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787380182.479631:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000eaede43a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874203867357056:0@lo:38: 00000100:00100000:3.0:1787380182.479710:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380182.479765:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867357056 00000100:00100000:3.0:1787380182.479771:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867357056 00000100:00100000:3.0:1787380182.479798:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380182.479804:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001813e497 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1874203867357056:12345-0@lo:38: 00010000:00080000:3.0:1787380182.479843:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:3.0:1787380182.479872:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcf3c46fdcad689b5 00000004:00100000:3.0:1787380182.479884:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787380182.479918:0:6522:0:(import.c:65:import_set_state_nolock()) 0000000068bd741a : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787380182.479961:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001813e497 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874203867357056:12345-0@lo:38: Request processed in 156us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380182.479968:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787380182.479997:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000eaede43a x1874203867357056/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787380192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380182.480007:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787380182.480012:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787380182.480018:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787380182.480021:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787380182.480023:0:3638:0:(import.c:65:import_set_state_nolock()) 000000006eee2b7d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787380182.480027:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000eaede43a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874203867357056:0@lo:38: 00000040:00080000:3.0:1787380182.484285:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1787380182.484427:0:7451:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1787380182.484456:0:7451:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787380182.484475:0:7451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000d67a4aeb/0xcf3c46fdcad68999 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad689a0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.484495:0:7451:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 00000000d67a4aeb/0xcf3c46fdcad68999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad689a0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787380182.484546:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787380182.484548:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787380182.484550:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380182.484551:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380182.484552:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380182.484554:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380182.484555:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787380182.484557:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787380182.484558:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787380182.484559:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380182.484561:0:7451:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787380182.484564:0:7451:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:1.0:1787380182.484566:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787380182.484567:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787380182.484568:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380182.484569:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380182.484570:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380182.484571:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380182.484572:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787380182.484573:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787380182.484574:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787380182.484575:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380182.484575:0:7451:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787380182.484598:0:7451:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1787380182.484614:0:7451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c8a6c110 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867357184:0@lo:253: 00000100:00100000:1.0:1787380182.484685:0:7451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380182.484714:0:7451:0:(client.c:2702:ptlrpc_set_wait()) set 000000001b379815 going to sleep for 11 seconds 00000100:00100000:1.0:1787380182.484733:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867357184 00000100:00100000:1.0:1787380182.484739:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867357184 00000100:00100000:1.0:1787380182.484777:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787380182.484784:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b57532 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:7451:x1874203867357184:12345-0@lo:253: 20000000:01000000:1.0:1787380182.484851:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787380182.484864:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:1.0:1787380182.485158:0:7471:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000001:00100000:1.0:1787380182.490879:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787380182.490929:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787380182.490941:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1787380182.491869:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787380182.491876:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787380182.491905:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000064178293/0xcf3c46fdcad689bc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.491924:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000065813e61/0xcf3c46fdcad688dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad688d5 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.491931:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f06130ef/0xcf3c46fdcad68984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6897d expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.491937:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000064178293/0xcf3c46fdcad689bc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.491972:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f06130ef/0xcf3c46fdcad68984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad6897d expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.491984:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f06130ef/0xcf3c46fdcad68984 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad6897d expref: 15 pid: 6515 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380182.491998:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002fd6e943 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874203867357312:0@lo:104: 00000100:00100000:2.0:1787380182.492054:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380182.492100:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000065813e61/0xcf3c46fdcad688dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad688d5 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.492114:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000065813e61/0xcf3c46fdcad688dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad688d5 expref: 15 pid: 6516 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380182.492122:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099f13cf9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874203867357440:0@lo:104: 00000100:00100000:2.0:1787380182.492144:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380182.492157:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b1610549 going to sleep for 11 seconds 00000100:00100000:2.0:1787380182.492181:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867357312 00000100:00100000:2.0:1787380182.492187:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867357312 00000100:00100000:2.0:1787380182.492219:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867357440 00000100:00100000:2.0:1787380182.492221:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867357440 00000100:00100000:2.0:1787380182.492235:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787380182.492242:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003df9ecb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:6537:x1874203867357312:12345-0@lo:104: 00010000:00010000:2.0:1787380182.492253:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: 0000000068ef8694/0xcf3c46fdcad6897d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68984 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.492297:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787380182.492302:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003df9ecb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:6537:x1874203867357312:12345-0@lo:104: Request processed in 61us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380182.492308:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787380182.492322:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787380182.492328:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6f8a628 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:6537:x1874203867357440:12345-0@lo:104: 00010000:00010000:2.0:1787380182.492334:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: 00000000cdb6afe7/0xcf3c46fdcad688d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad688dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380182.492364:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787380182.492368:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6f8a628 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:6537:x1874203867357440:12345-0@lo:104: Request processed in 42us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380182.492383:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787380182.492416:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002fd6e943 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874203867357312:0@lo:104: 00000100:00100000:2.0:1787380182.492423:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099f13cf9 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874203867357440:0@lo:104: 00010000:00010000:2.0:1787380182.492437:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000064178293/0xcf3c46fdcad689bc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.492517:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787380182.492522:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: 0000000068ef8694/0xcf3c46fdcad6897d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68984 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.492529:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068ef8694 already unused, calling callback (00000000a6065147) 10000000:00010000:3.0:1787380182.492539:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: 0000000068ef8694/0xcf3c46fdcad6897d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68984 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.492546:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: 0000000068ef8694/0xcf3c46fdcad6897d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68984 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380182.492552:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: 0000000068ef8694/0xcf3c46fdcad6897d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68984 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380182.492557:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380182.492592:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: 0000000068ef8694/0xcf3c46fdcad6897d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68984 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.492600:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380182.492616:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: 0000000068ef8694/0xcf3c46fdcad6897d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68984 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.492622:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: 0000000068ef8694/0xcf3c46fdcad6897d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68984 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.492632:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380182.492635:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: 00000000cdb6afe7/0xcf3c46fdcad688d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad688dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.492640:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cdb6afe7 already unused, calling callback (00000000a6065147) 10000000:00010000:3.0:1787380182.492642:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: 00000000cdb6afe7/0xcf3c46fdcad688d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad688dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.492659:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: 00000000cdb6afe7/0xcf3c46fdcad688d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad688dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380182.492674:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: 00000000cdb6afe7/0xcf3c46fdcad688d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad688dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380182.492679:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380182.492691:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: 00000000cdb6afe7/0xcf3c46fdcad688d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad688dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.492696:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380182.492709:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: 00000000cdb6afe7/0xcf3c46fdcad688d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad688dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.492716:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: 00000000cdb6afe7/0xcf3c46fdcad688d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad688dc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.492729:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380182.492730:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380182.492731:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380182.492742:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f1e1ae61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867357696:0@lo:103: 00000100:00100000:3.0:1787380182.492771:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380182.492837:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867357696 00000100:00100000:3.0:1787380182.492841:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867357696 00010000:00010000:3.0:1787380182.492858:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000065813e61/0xcf3c46fdcad688dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad688d5 expref: 16 pid: 6516 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380182.492878:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787380182.492884:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c1a6732 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:3641:x1874203867357696:12345-0@lo:103: 00010000:00010000:3.0:1787380182.492905:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380182.492909:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000065813e61/0xcf3c46fdcad688dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad688d5 expref: 16 pid: 6516 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.492924:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000065813e61/0xcf3c46fdcad688dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad688d5 expref: 16 pid: 6516 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.492935:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000065813e61/0xcf3c46fdcad688dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad688d5 expref: 16 pid: 6516 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380182.492947:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380182.492974:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c1a6732 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:3641:x1874203867357696:12345-0@lo:103: Request processed in 91us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380182.492980:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787380182.493006:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f1e1ae61 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867357696:0@lo:103: 00010000:00010000:1.0:1787380182.494720:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380182.494743:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000191ef8aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867357568:0@lo:103: 00000100:00100000:1.0:1787380182.494800:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380182.495377:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867357568 00000100:00100000:1.0:1787380182.495385:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867357568 00010000:00010000:1.0:1787380182.495410:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f06130ef/0xcf3c46fdcad68984 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6897d expref: 15 pid: 6515 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380182.495452:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787380182.495460:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000010090744 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:3640:x1874203867357568:12345-0@lo:103: 00010000:00010000:1.0:1787380182.495473:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380182.495477:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f06130ef/0xcf3c46fdcad68984 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6897d expref: 15 pid: 6515 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.495487:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f06130ef/0xcf3c46fdcad68984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad6897d expref: 15 pid: 6515 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.495503:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f06130ef/0xcf3c46fdcad68984 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad6897d expref: 15 pid: 6515 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.495515:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000064178293/0xcf3c46fdcad689bc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.495523:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000064178293/0xcf3c46fdcad689bc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787380182.495545:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005298673s 00010000:00010000:1.0:1787380182.495549:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000064178293/0xcf3c46fdcad689bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.495556:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000064178293/0xcf3c46fdcad689bc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.495561:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000064178293/0xcf3c46fdcad689bc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.495567:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000064178293/0xcf3c46fdcad689bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.495572:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000064178293 already unused, calling callback (00000000e476b6df) 00010000:00010000:1.0:1787380182.495576:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000064178293/0xcf3c46fdcad689bc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.495583:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000064178293/0xcf3c46fdcad689bc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.495597:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000064178293/0xcf3c46fdcad689bc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.495607:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380182.495639:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000010090744 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:3640:x1874203867357568:12345-0@lo:103: Request processed in 180us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380182.495658:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787380182.495708:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000191ef8aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867357568:0@lo:103: 00010000:00010000:1.0:1787380182.495736:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000064178293/0xcf3c46fdcad689bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.495748:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000064178293/0xcf3c46fdcad689bc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380182.495754:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000064178293/0xcf3c46fdcad689bc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380182.495805:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b57532 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+13:7451:x1874203867357184:12345-0@lo:253: Request processed in 11021us (11120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380182.495834:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787380182.495869:0:7451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c8a6c110 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:7451:1874203867357184:0@lo:253: 10000000:01000000:1.0:1787380182.495879:0:7451:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787380182.495882:0:7451:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787380182.495885:0:7451:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787380182.495886:0:7451:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380182.495887:0:7451:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380182.495888:0:7451:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380182.495889:0:7451:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380182.495891:0:7451:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787380182.495908:0:7451:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787380182.495910:0:7451:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787380182.495911:0:7451:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380182.495912:0:7451:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787380182.495921:0:7451:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787380182.502594:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1787380182.503189:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787380182.503393:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787380182.503580:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787380182.503769:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787380182.504282:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1787380182.505408:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1787380182.505643:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1787380182.506052:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1787380182.506223:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1787380182.506383:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1787380182.506550:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1787380182.508135:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1787380182.508405:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1787380182.508455:0:7475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c8a6c110 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1874203867357824:0@lo:700: 00000100:00100000:1.0:1787380182.508526:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1787380182.508595:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1787380182.508753:0:7475:0:(client.c:2702:ptlrpc_set_wait()) set 0000000066980732 going to sleep for 11 seconds 00000020:00080000:2.0:1787380182.508786:0:7474:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1787380182.508789:0:7474:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:3.0:1787380182.508977:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867357824 00000100:00100000:3.0:1787380182.508985:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867357824 00000100:00100000:3.0:1787380182.509057:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787380182.509064:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ed46b9c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1874203867357824:12345-0@lo:700: 00000100:00100000:1.0:1787380182.509392:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000de9b5db pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874203867357952:0@lo:1000: 00000100:00100000:1.0:1787380182.509429:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380182.509460:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b4855b8e going to sleep for 11 seconds 00000040:01000000:0.0:1787380182.509804:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1787380182.509968:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787380182.510408:0:7451:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787380182.510415:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1787380182.510537:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787380182.511458:0:7451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787380182.511969:0:7451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787380182.511997:0:7451:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1787380182.512145:0:7451:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787380182.512505:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867357952 00000100:00100000:3.0:1787380182.512515:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867357952 00000100:00100000:3.0:1787380182.512574:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380182.512582:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007831e31e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874203867357952:12345-0@lo:1000: 00000100:00100000:3.0:1787380182.512699:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007831e31e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874203867357952:12345-0@lo:1000: Request processed in 118us (3270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380182.512707:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787380182.512907:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000de9b5db pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874203867357952:0@lo:1000: 00000040:01000000:1.0:1787380182.512940:0:7476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1787380182.512972:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000de9b5db pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874203867358080:0@lo:700: 00000100:00100000:1.0:1787380182.513007:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380182.513039:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 0000000096412cd9 going to sleep for 11 seconds 00000100:00100000:3.0:1787380182.513098:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867358080 00000100:00100000:3.0:1787380182.513102:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867358080 00000100:00100000:3.0:1787380182.513136:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787380182.513142:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5165389 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874203867358080:12345-0@lo:700: 00000100:00100000:3.0:1787380182.513180:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5165389 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874203867358080:12345-0@lo:700: Request processed in 39us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380182.513193:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380182.513255:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000de9b5db pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874203867358080:0@lo:700: 00000100:00100000:1.0:1787380182.513294:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000de9b5db pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1874203867358208:0@lo:900: 00000100:00100000:1.0:1787380182.513317:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380182.513339:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 0000000096412cd9 going to sleep for 11 seconds 00000100:00100000:3.0:1787380182.513382:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867358208 00000100:00100000:3.0:1787380182.513386:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867358208 00000100:00100000:3.0:1787380182.513413:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787380182.513419:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a9adbcb pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1874203867358208:12345-0@lo:900: 00000100:00100000:3.0:1787380182.513451:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a9adbcb pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1874203867358208:12345-0@lo:900: Request processed in 33us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380182.513457:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787380182.513512:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000de9b5db x1874203867358208/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787380198 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380182.513522:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000de9b5db pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1874203867358208:0@lo:900: 00000100:00100000:1.0:1787380182.513574:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000de9b5db pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874203867358336:0@lo:1000: 00000100:00100000:1.0:1787380182.513595:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380182.513614:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 0000000087b25151 going to sleep for 11 seconds 00000100:00100000:3.0:1787380182.513658:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867358336 00000100:00100000:3.0:1787380182.513661:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867358336 00000100:00100000:3.0:1787380182.513686:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380182.513691:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f024a99e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874203867358336:12345-0@lo:1000: 00000100:00100000:3.0:1787380182.513731:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f024a99e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874203867358336:12345-0@lo:1000: Request processed in 41us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380182.513737:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787380182.513852:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000de9b5db pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874203867358336:0@lo:1000: 00000004:00080000:1.0:1787380182.513885:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000096412cd9 with version 0 00000020:00100000:1.0:1787380182.513915:0:7476:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1787380182.513920:0:7476:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000000de9b5db x1874203867358592/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787380182.513931:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000de9b5db pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874203867358592:0@lo:1000: 00000100:00100000:1.0:1787380182.513951:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380182.513965:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 000000007ed8a47d going to sleep for 11 seconds 00000100:00100000:3.0:1787380182.514011:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867358592 00000100:00100000:3.0:1787380182.514015:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867358592 00000100:00100000:3.0:1787380182.514041:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787380182.514046:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d380b0b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874203867358592:12345-0@lo:1000: 00080000:10000000:0.0:1787380182.514542:0:7451:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1787380182.515306:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787380182.515436:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787380182.515553:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787380182.515694:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787380182.515907:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787380182.516100:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787380182.516227:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787380182.516358:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787380182.516520:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787380182.516644:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787380182.516792:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787380182.516980:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787380182.517145:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787380182.517274:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787380182.517401:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787380182.518196:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787380182.518486:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787380182.518643:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787380182.519048:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787380182.519194:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787380182.519323:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787380182.519447:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787380182.519569:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787380182.519926:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787380182.520078:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787380182.520222:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787380182.520365:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787380182.520517:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787380182.520657:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787380182.520789:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787380182.521105:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787380182.521346:0:7451:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787380182.521545:0:7451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1787380182.524103:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:0.0:1787380182.524995:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:3.0:1787380182.525060:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d380b0b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1874203867358592:12345-0@lo:1000: Request processed in 11011us (11105us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787380182.525073:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1787380182.525613:0:7476:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1787380182.525620:0:7476:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787380182.525634:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000de9b5db pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874203867358592:0@lo:1000: 00000100:00100000:1.0:1787380182.525718:0:7476:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000de9b5db pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874203867358720:0@lo:1000: 00000100:00100000:1.0:1787380182.525860:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380182.525916:0:7476:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b4855b8e going to sleep for 11 seconds 00000100:00100000:2.0:1787380182.525970:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867358720 00000100:00100000:2.0:1787380182.525977:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867358720 00000100:00100000:2.0:1787380182.526016:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787380182.526024:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eaede43a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874203867358720:12345-0@lo:1000: 00000100:00100000:2.0:1787380182.526094:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eaede43a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1874203867358720:12345-0@lo:1000: Request processed in 71us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380182.526446:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787380182.526485:0:7476:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000de9b5db pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1874203867358720:0@lo:1000: 00000040:00080000:1.0:1787380182.526504:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1787380182.526530:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000096412cd9 with version 1 00000001:00080000:2.0:1787380182.526985:0:7451:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787380182.527010:0:7451:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb3a80558b988 00100000:10000000:2.0:1787380182.527018:0:7451:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:1.0:1787380182.528538:0:7476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787380182.528604:0:7476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1787380182.529003:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ed46b9c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1874203867357824:12345-0@lo:700: Request processed in 19937us (20474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380182.529019:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787380182.529121:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c8a6c110 x1874203867357824/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787380198 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380182.529135:0:7475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c8a6c110 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1874203867357824:0@lo:700: 40000000:02000000:1.0:1787380182.529145:0:7475:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000004:00080000:3.0:1787380182.529357:0:7466:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000a9434306 version 1 rpc_version 1 00000020:00100000:3.0:1787380182.529383:0:7466:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787380182.529389:0:7466:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000f1e1ae61 x1874203867358976/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787380182.529407:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f1e1ae61 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1874203867358976:0@lo:1000: 00000100:00100000:3.0:1787380182.529466:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380182.529501:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set 0000000018e185b6 going to sleep for 11 seconds 00000100:00100000:2.0:1787380182.529671:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867358976 00000100:00100000:2.0:1787380182.529677:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867358976 00000100:00100000:2.0:1787380182.529714:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787380182.529721:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000609c613 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1874203867358976:12345-0@lo:1000: 00000020:01000004:3.0:1787380182.530536:0:7451:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787380182.530565:0:7451:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787380182.530582:0:7451:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787380182.530606:0:7451:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1787380182.533036:0:7451:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787380182.533209:0:7451:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:1.0:1787380182.542890:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1787380182.543019:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000609c613 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1874203867358976:12345-0@lo:1000: Request processed in 13295us (13550us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787380182.543035:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1787380182.545199:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1787380182.545210:0:7466:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787380182.545229:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f1e1ae61 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7466:1874203867358976:0@lo:1000: 00000040:00080000:1.0:1787380182.582472:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380182.586208:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787380182.586276:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787380182.586280:0:7475:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1787380183.116042:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380184.146678:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380185.163921:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380186.188048:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787380187.189430:0:7720:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787380187.213141:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380187.788115:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000de9b5db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867359232:0@lo:400: 00000100:00100000:1.0:1787380187.788180:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380187.788229:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380187.788235:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000095c1d999 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867359360:0@lo:400: 00000100:00100000:1.0:1787380187.788261:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380187.788302:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867359232 00000100:00100000:1.0:1787380187.788309:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867359232 00000100:00100000:1.0:1787380187.788353:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787380187.788361:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b792b396 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867359232:12345-0@lo:400: 00000100:00100000:1.0:1787380187.788409:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b792b396 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867359232:12345-0@lo:400: Request processed in 49us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380187.788416:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787380187.788438:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867359360 00000100:00100000:1.0:1787380187.788441:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867359360 00000100:00100000:1.0:1787380187.788464:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787380187.788469:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e54fc420 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867359360:12345-0@lo:400: 00000100:00100000:1.0:1787380187.788516:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e54fc420 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867359360:12345-0@lo:400: Request processed in 47us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380187.788523:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787380187.788563:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000095c1d999 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867359360:0@lo:400: 00010000:00080000:1.0:1787380187.788575:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000de9b5db x1874203867359232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380187.788605:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000de9b5db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867359232:0@lo:400: 00000100:00100000:3.0:1787380187.788664:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c8a6c110 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867359104:0@lo:400: 00000100:00100000:3.0:1787380187.788697:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380187.788727:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380187.788733:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e69baa92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867359488:0@lo:400: 00000100:00100000:3.0:1787380187.788754:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380187.788780:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867359488 00000100:00100000:3.0:1787380187.788784:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867359488 00000100:00100000:3.0:1787380187.788831:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787380187.788838:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1e1ae61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867359488:12345-0@lo:400: 00000100:00100000:3.0:1787380187.788885:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1e1ae61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867359488:12345-0@lo:400: Request processed in 48us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380187.788891:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787380187.788915:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000e69baa92 x1874203867359488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380187.788936:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e69baa92 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867359488:0@lo:400: 00000100:00100000:1.0:1787380187.789113:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867359104 00000100:00100000:1.0:1787380187.789119:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867359104 00000100:00100000:1.0:1787380187.789154:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787380187.789160:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebb84fcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+13:3642:x1874203867359104:12345-0@lo:400: 00000100:00100000:1.0:1787380187.789200:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebb84fcd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+13:3642:x1874203867359104:12345-0@lo:400: Request processed in 40us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380187.789206:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787380187.789249:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c8a6c110 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867359104:0@lo:400: 00000100:00100000:0.0:1787380187.789427:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380187.789436:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000099f13cf9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867359616:0@lo:41: 00000100:00100000:0.0:1787380187.789468:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380187.789602:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867359616 00000100:00100000:2.0:1787380187.789607:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867359616 00000100:00100000:2.0:1787380187.789640:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787380187.789646:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043472a58 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867359616:12345-0@lo:41: 00000004:00000024:2.0:1787380187.789668:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1787380187.789723:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043472a58 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867359616:12345-0@lo:41: Request processed in 78us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380187.789730:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787380187.789795:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000099f13cf9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867359616:0@lo:41: 00000020:00000004:0.0:1787380188.020800:0:7772:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787380188.021106:0:7772:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787380188.236003:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380189.259960:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787380189.323974:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787380189.323982:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6ff3dad800 from 4 10000000:01000000:2.0:1787380189.323986:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787380189.324040:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 0000000072b51db6/0xcf3c46fdcad689c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380189.324052:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 0000000072b51db6/0xcf3c46fdcad689c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380189.324062:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 0000000072b51db6/0xcf3c46fdcad689c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380189.324083:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002fd6e943 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867359744:0@lo:101: 00000100:00100000:2.0:1787380189.324144:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380189.324212:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c09b2859 going to sleep for 11 seconds 00000100:00100000:1.0:1787380189.324217:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867359744 00000100:00100000:1.0:1787380189.324226:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867359744 00000100:00100000:1.0:1787380189.324274:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787380189.324280:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038d80308 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+13:6518:x1874203867359744:12345-0@lo:101: 00010000:00010000:1.0:1787380189.324292:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380189.324302:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006421a893/0xcf3c46fdcad689ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad689c3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380189.324323:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006421a893/0xcf3c46fdcad689ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad689c3 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380189.324333:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006421a893/0xcf3c46fdcad689ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad689c3 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380189.324342:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006421a893, rc 0) 00000100:00100000:1.0:1787380189.324396:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038d80308 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:6518:x1874203867359744:12345-0@lo:101: Request processed in 107us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380189.324418:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787380189.324550:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002fd6e943 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867359744:0@lo:101: 00010000:00010000:2.0:1787380189.324634:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 0000000072b51db6/0xcf3c46fdcad689c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad689ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380189.324643:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 0000000072b51db6/0xcf3c46fdcad689c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad689ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380189.324688:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002fd6e943 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867359872:0@lo:256: 00000100:00100000:2.0:1787380189.324717:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380189.324738:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c09b2859 going to sleep for 11 seconds 00000100:00100000:3.0:1787380189.324895:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867359872 00000100:00100000:3.0:1787380189.324900:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867359872 00000100:00100000:3.0:1787380189.324929:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787380189.324934:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016db56b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:6518:x1874203867359872:12345-0@lo:256: 20000000:01000000:3.0:1787380189.325266:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787380189.325281:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787380189.325284:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787380189.325369:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016db56b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:6518:x1874203867359872:12345-0@lo:256: Request processed in 435us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380189.325377:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787380189.325477:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002fd6e943 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867359872:0@lo:256: 10000000:01000000:2.0:1787380189.325524:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787380189.325530:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 0000000072b51db6/0xcf3c46fdcad689c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad689ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380189.325537:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 0000000072b51db6/0xcf3c46fdcad689c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad689ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380189.325547:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787380189.325548:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6fc873b000 from 21 10000000:01000000:2.0:1787380189.325550:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787380189.325567:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000d2ccc9db/0xcf3c46fdcad689d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380189.325573:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000d2ccc9db/0xcf3c46fdcad689d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380189.325579:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000d2ccc9db/0xcf3c46fdcad689d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380189.325591:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002fd6e943 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867360000:0@lo:101: 00000100:00100000:2.0:1787380189.325620:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380189.325759:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c09b2859 going to sleep for 11 seconds 00000100:00100000:3.0:1787380189.326901:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867360000 00000100:00100000:3.0:1787380189.326912:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867360000 00000100:00100000:1.0:1787380189.329039:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787380189.329060:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e921ec7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:6518:x1874203867360000:12345-0@lo:101: 00010000:00010000:1.0:1787380189.329078:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380189.329096:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000434e9bfa/0xcf3c46fdcad689d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad689d1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380189.329123:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000434e9bfa/0xcf3c46fdcad689d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad689d1 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380189.329133:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000434e9bfa/0xcf3c46fdcad689d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad689d1 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380189.329141:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000434e9bfa, rc 0) 00000100:00100000:1.0:1787380189.329288:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e921ec7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:6518:x1874203867360000:12345-0@lo:101: Request processed in 237us (3667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380189.329295:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787380189.329377:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002fd6e943 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867360000:0@lo:101: 00010000:00010000:2.0:1787380189.329391:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000d2ccc9db/0xcf3c46fdcad689d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad689d8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380189.329400:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000d2ccc9db/0xcf3c46fdcad689d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad689d8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380189.329483:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002fd6e943 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867360128:0@lo:501: 00000100:00100000:2.0:1787380189.329515:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380189.329589:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c09b2859 going to sleep for 11 seconds 00000100:00100000:1.0:1787380189.329629:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867360128 00000100:00100000:1.0:1787380189.329637:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867360128 00000100:00100000:1.0:1787380189.329884:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787380189.329891:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa9d747c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:6518:x1874203867360128:12345-0@lo:501: 00000100:00100000:1.0:1787380189.330013:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa9d747c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:6518:x1874203867360128:12345-0@lo:501: Request processed in 123us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380189.330019:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787380189.330234:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002fd6e943 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867360128:0@lo:501: 00000100:00100000:0.0:1787380189.330267:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867360256:0@lo:503: 00000100:00100000:0.0:1787380189.330310:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380189.330339:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 000000000bb79f52 going to sleep for 11 seconds 00000100:00100000:1.0:1787380189.330485:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867360256 00000100:00100000:1.0:1787380189.330490:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867360256 00000100:00100000:1.0:1787380189.330522:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787380189.330528:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065da2557 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:6518:x1874203867360256:12345-0@lo:503: 00000100:00100000:1.0:1787380189.331054:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065da2557 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:6518:x1874203867360256:12345-0@lo:503: Request processed in 525us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380189.331063:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787380189.331191:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867360256:0@lo:503: 00000100:00100000:1.0:1787380189.332286:0:7825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c8a6c110 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:7825:1874203867360384:0@lo:502: 00000100:00100000:1.0:1787380189.332347:0:7825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380189.332386:0:7825:0:(client.c:2702:ptlrpc_set_wait()) set 0000000000f80dff going to sleep for 11 seconds 00000100:00100000:2.0:1787380189.332449:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867360384 00000100:00100000:2.0:1787380189.332456:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867360384 00000100:00100000:2.0:1787380189.332535:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787380189.332543:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a5382fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:7825:x1874203867360384:12345-0@lo:502: 00000100:00100000:2.0:1787380189.333193:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a5382fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:7825:x1874203867360384:12345-0@lo:502: Request processed in 650us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380189.333203:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787380189.333296:0:7825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c8a6c110 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:7825:1874203867360384:0@lo:502: 00000100:00100000:1.0:1787380189.333349:0:7825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c8a6c110 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:7825:1874203867360512:0@lo:502: 00000100:00100000:1.0:1787380189.333383:0:7825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380189.333455:0:7825:0:(client.c:2702:ptlrpc_set_wait()) set 0000000000f80dff going to sleep for 11 seconds 00000100:00100000:2.0:1787380189.333494:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867360512 00000100:00100000:2.0:1787380189.333499:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867360512 00000100:00100000:2.0:1787380189.333569:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787380189.333584:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000498bb2b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:7825:x1874203867360512:12345-0@lo:502: 00000100:00100000:2.0:1787380189.333748:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000498bb2b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:7825:x1874203867360512:12345-0@lo:502: Request processed in 165us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380189.333754:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787380189.333923:0:7825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c8a6c110 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:7825:1874203867360512:0@lo:502: 00000040:00080000:0.0:1787380189.333943:0:7825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1787380189.334108:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1787380189.334185:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787380189.334192:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000d2ccc9db/0xcf3c46fdcad689d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad689d8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380189.334202:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 00000000d2ccc9db/0xcf3c46fdcad689d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad689d8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380189.334211:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787380189.334219:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6fc873b000 from 4 10000000:01000000:2.0:1787380189.334222:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787380189.334242:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 0000000064178293/0xcf3c46fdcad689df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380189.334250:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 0000000064178293/0xcf3c46fdcad689df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380189.334257:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 0000000064178293/0xcf3c46fdcad689df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380189.334269:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005ad7e2ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867360640:0@lo:101: 00000100:00100000:2.0:1787380189.334296:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380189.334364:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 0000000004ec9069 going to sleep for 11 seconds 00000100:00100000:1.0:1787380189.334404:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867360640 00000100:00100000:1.0:1787380189.334408:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867360640 00000100:00100000:1.0:1787380189.334475:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787380189.334482:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c14dae9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:6518:x1874203867360640:12345-0@lo:101: 00010000:00010000:1.0:1787380189.334491:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380189.334501:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000050ba9f80/0xcf3c46fdcad689e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad689df expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380189.334525:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000050ba9f80/0xcf3c46fdcad689e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad689df expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380189.334534:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000050ba9f80/0xcf3c46fdcad689e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad689df expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380189.334543:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000050ba9f80, rc 0) 00000100:00100000:1.0:1787380189.334586:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c14dae9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867360640:12345-0@lo:101: Request processed in 106us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380189.334602:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787380189.334749:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005ad7e2ff pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867360640:0@lo:101: 00010000:00010000:0.0:1787380189.334761:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 0000000064178293/0xcf3c46fdcad689df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad689e6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380189.334769:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 0000000064178293/0xcf3c46fdcad689df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad689e6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380189.334851:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867360768:0@lo:256: 00000100:00100000:0.0:1787380189.334894:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380189.334908:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 000000000bb79f52 going to sleep for 11 seconds 00000100:00100000:1.0:1787380189.334964:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867360768 00000100:00100000:1.0:1787380189.334968:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867360768 00000100:00100000:1.0:1787380189.334987:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787380189.334992:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db5ef2ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867360768:12345-0@lo:256: 20000000:01000000:1.0:1787380189.335004:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787380189.335018:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787380189.335021:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787380189.335098:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db5ef2ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867360768:12345-0@lo:256: Request processed in 105us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380189.335104:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787380189.335177:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867360768:0@lo:256: 10000000:01000000:0.0:1787380189.335214:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787380189.335222:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 0000000064178293/0xcf3c46fdcad689df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad689e6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380189.335228:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 0000000064178293/0xcf3c46fdcad689df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad689e6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380189.335234:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787380189.335236:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1787380189.335238:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787380189.335252:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000aa0b0317/0xcf3c46fdcad689ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380189.335257:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000aa0b0317/0xcf3c46fdcad689ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380189.335263:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000aa0b0317/0xcf3c46fdcad689ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380189.335272:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867360896:0@lo:101: 00000100:00100000:0.0:1787380189.335293:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380189.335317:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 000000000bb79f52 going to sleep for 11 seconds 00000100:00100000:1.0:1787380189.335356:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867360896 00000100:00100000:1.0:1787380189.335360:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867360896 00000100:00100000:1.0:1787380189.335375:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787380189.335379:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff690d46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867360896:12345-0@lo:101: 00010000:00010000:1.0:1787380189.335386:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380189.335392:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000575a65a/0xcf3c46fdcad689f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad689ed expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380189.335405:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000575a65a/0xcf3c46fdcad689f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad689ed expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380189.335412:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000575a65a/0xcf3c46fdcad689f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad689ed expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380189.335418:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000575a65a, rc 0) 00000100:00100000:1.0:1787380189.335449:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff690d46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867360896:12345-0@lo:101: Request processed in 69us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380189.335462:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787380189.335541:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867360896:0@lo:101: 00010000:00010000:0.0:1787380189.335550:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000aa0b0317/0xcf3c46fdcad689ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad689f4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380189.335556:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000aa0b0317/0xcf3c46fdcad689ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad689f4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380189.335608:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867361024:0@lo:501: 00000100:00100000:0.0:1787380189.335647:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380189.335667:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 000000000bb79f52 going to sleep for 11 seconds 00000100:00100000:1.0:1787380189.335751:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867361024 00000100:00100000:1.0:1787380189.335755:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867361024 00000100:00100000:1.0:1787380189.335788:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787380189.335792:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050690bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867361024:12345-0@lo:501: 00000100:00100000:1.0:1787380189.335927:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050690bb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867361024:12345-0@lo:501: Request processed in 134us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380189.335934:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787380189.336077:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867361024:0@lo:501: 00000100:00100000:0.0:1787380189.336100:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867361152:0@lo:503: 00000100:00100000:0.0:1787380189.336134:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380189.336158:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 000000000bb79f52 going to sleep for 11 seconds 00000100:00100000:1.0:1787380189.336196:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867361152 00000100:00100000:1.0:1787380189.336200:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867361152 00000100:00100000:1.0:1787380189.336258:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787380189.336265:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008cb1afac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867361152:12345-0@lo:503: 00000100:00100000:1.0:1787380189.336343:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008cb1afac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867361152:12345-0@lo:503: Request processed in 78us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380189.336349:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787380189.336423:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867361152:0@lo:503: 00000100:00100000:0.0:1787380189.336601:0:7826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:7826:1874203867361280:0@lo:502: 00000100:00100000:0.0:1787380189.336634:0:7826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380189.337041:0:7826:0:(client.c:2702:ptlrpc_set_wait()) set 00000000237cc8ed going to sleep for 11 seconds 00000100:00100000:3.0:1787380189.337097:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867361280 00000100:00100000:3.0:1787380189.337104:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867361280 00000100:00100000:3.0:1787380189.337130:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787380189.337135:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c63c536f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:7826:x1874203867361280:12345-0@lo:502: 00000100:00100000:3.0:1787380189.337254:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c63c536f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:7826:x1874203867361280:12345-0@lo:502: Request processed in 118us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380189.337261:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787380189.337322:0:7826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:7826:1874203867361280:0@lo:502: 00000020:01000000:0.0:1787380189.337344:0:7826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380189.337354:0:7826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380189.337356:0:7826:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787380189.337360:0:7826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787380189.337364:0:7826:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.130@tcp to nid 0x20000c0a8ce82 (192.168.206.130@tcp) 00000020:00000080:0.0:1787380189.337383:0:7826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787380189.337396:0:7826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000008088d5f0) 00000020:00000080:0.0:1787380189.337414:0:7826:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1787380189.337419:0:7826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787380189.337503:0:7826:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787380189.337508:0:7826:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787380189.337514:0:7826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3c46fdcad68a02 00010000:00080000:0.0:1787380189.337539:0:7826:0:(ldlm_lib.c:102:import_set_conn()) imp 000000005f38358a@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.130@tcp at head 00010000:00010000:0.0:1787380189.339598:0:7826:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1787380189.340732:0:7826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787380189.340745:0:7826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787380189.340778:0:7826:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787380189.340799:0:7826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3c46fdcad68a09 00000100:00080000:1.0:1787380189.340838:0:7826:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787380189.340843:0:7826:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 000000005f38358a using connection 192.168.206.130@tcp/0@lo 00000100:00100000:1.0:1787380189.340887:0:7826:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000de9b5db x1874203867361408/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787380189.340914:0:7826:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1787380189.340950:0:7826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1787380189.341098:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000de9b5db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867361408:0@lo:38: 00000100:00100000:2.0:1787380189.341182:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380189.341597:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000173caddd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867361664:0@lo:400: 00000100:00100000:0.0:1787380189.341624:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380189.341652:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380189.341658:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867361536:0@lo:400: 00000100:00100000:0.0:1787380189.341679:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380189.341701:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bd242633 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867361792:0@lo:400: 00000100:00100000:0.0:1787380189.341724:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380189.341767:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867361408 00000100:00100000:0.0:1787380189.341779:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867361408 00000100:00100000:0.0:1787380189.341799:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867361664 00000100:00100000:0.0:1787380189.341802:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867361664 00000100:00100000:0.0:1787380189.341851:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787380189.341872:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034da2eec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1874203867361408:12345-0@lo:38: 00010000:00080000:0.0:1787380189.341895:0:6527:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:0.0:1787380189.341937:0:6527:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3c46fdcad68a10 00000004:00100000:0.0:1787380189.341949:0:6527:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787380189.341954:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1787380189.342040:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867361536 00000100:00100000:0.0:1787380189.342045:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867361536 00000100:00100000:0.0:1787380189.342068:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867361792 00000100:00100000:0.0:1787380189.342070:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867361792 00000100:00100000:0.0:1787380189.342082:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787380189.342087:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7315d20 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867361536:12345-0@lo:400: 00000100:00100000:0.0:1787380189.342129:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7315d20 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867361536:12345-0@lo:400: Request processed in 42us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380189.342135:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787380189.342149:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787380189.342154:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4d07f12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867361792:12345-0@lo:400: 00000100:00100000:0.0:1787380189.342182:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4d07f12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867361792:12345-0@lo:400: Request processed in 28us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380189.342194:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787380189.342233:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000bd242633 x1874203867361792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380189.342257:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bd242633 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867361792:0@lo:400: 00010000:00080000:0.0:1787380189.342283:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b3536ca0 x1874203867361536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380189.342291:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867361536:0@lo:400: 00000100:00080000:2.0:1787380189.342560:0:7829:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000003386c46b x1874203867361920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380189.342577:0:7829:0:(client.c:2702:ptlrpc_set_wait()) set 000000007773f658 going to sleep for 0 seconds 00000020:01000000:1.0:1787380189.343551:0:7826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380189.343558:0:7826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380189.343570:0:7826:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1787380189.343574:0:7826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380189.343577:0:7826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380189.343579:0:7826:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787380189.343581:0:7826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787380189.343582:0:7826:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787380189.343607:0:7826:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000095c1d999 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:7826:1874203867362048:0@lo:502: 00000100:00100000:1.0:1787380189.343671:0:7826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380189.343704:0:7826:0:(client.c:2702:ptlrpc_set_wait()) set 0000000000f80dff going to sleep for 11 seconds 00000100:00100000:3.0:1787380189.343769:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867362048 00000100:00100000:3.0:1787380189.343776:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867362048 00000100:00100000:0.0:1787380189.343926:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787380189.343936:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc00deee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:7826:x1874203867362048:12345-0@lo:502: 00000100:00100000:0.0:1787380189.344185:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc00deee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:7826:x1874203867362048:12345-0@lo:502: Request processed in 251us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380189.344193:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787380189.344615:0:7826:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000095c1d999 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:7826:1874203867362048:0@lo:502: 00000020:01000000:2.0:1787380189.344685:0:7826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380189.344691:0:7826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380189.344693:0:7826:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787380189.344697:0:7826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1787380189.344981:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787380189.345000:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787380189.345007:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000aa0b0317/0xcf3c46fdcad689ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad689f4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380189.345018:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 00000000aa0b0317/0xcf3c46fdcad689ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad689f4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380189.345028:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787380189.345030:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9d6ff8828000 from 1 10000000:01000000:0.0:1787380189.345032:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787380189.345058:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000b8f3e650/0xcf3c46fdcad68a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380189.345076:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000b8f3e650/0xcf3c46fdcad68a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380189.345084:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000b8f3e650/0xcf3c46fdcad68a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380189.345098:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867362176:0@lo:101: 00000100:00100000:0.0:1787380189.345132:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380189.345198:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a2a406ff going to sleep for 11 seconds 00000100:00100000:2.0:1787380189.345230:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867362176 00000100:00100000:2.0:1787380189.345236:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867362176 00000100:00100000:2.0:1787380189.345438:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787380189.345447:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb68afc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867362176:12345-0@lo:101: 00010000:00010000:2.0:1787380189.345458:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380189.345475:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f06130ef/0xcf3c46fdcad68a1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68a17 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380189.345496:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f06130ef/0xcf3c46fdcad68a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a17 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380189.345506:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f06130ef/0xcf3c46fdcad68a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a17 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380189.345514:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f06130ef, rc 0) 00000100:00100000:2.0:1787380189.345593:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb68afc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867362176:12345-0@lo:101: Request processed in 148us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380189.345599:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787380189.345710:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867362176:0@lo:101: 00010000:00010000:0.0:1787380189.345721:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000b8f3e650/0xcf3c46fdcad68a17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68a1e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380189.345728:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000b8f3e650/0xcf3c46fdcad68a17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68a1e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380189.345776:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867362304:0@lo:501: 00000100:00100000:0.0:1787380189.345798:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380189.345926:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a2a406ff going to sleep for 11 seconds 00000100:00100000:1.0:1787380189.346067:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867362304 00000100:00100000:1.0:1787380189.346072:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867362304 00000100:00100000:1.0:1787380189.346108:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787380189.346114:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004a071fad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867362304:12345-0@lo:501: 00000100:00100000:1.0:1787380189.346185:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004a071fad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867362304:12345-0@lo:501: Request processed in 71us (386us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787380189.346191:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787380189.346253:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867362304:0@lo:501: 10000000:01000000:0.0:1787380189.346278:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787380189.346283:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: 00000000b8f3e650/0xcf3c46fdcad68a17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68a1e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380189.346290:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: 00000000b8f3e650/0xcf3c46fdcad68a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68a1e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787380189.356720:0:6527:0:(import.c:65:import_set_state_nolock()) 00000000e7fee49d : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787380189.356997:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034da2eec pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1874203867361408:12345-0@lo:38: Request processed in 15123us (15814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380189.357010:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787380189.357034:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787380189.357043:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003154ffc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867361664:12345-0@lo:400: 00000100:00100000:0.0:1787380189.357140:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003154ffc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867361664:12345-0@lo:400: Request processed in 99us (15515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380189.357147:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787380189.357265:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787380189.357274:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787380189.357283:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787380189.357288:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787380189.357290:0:3638:0:(import.c:65:import_set_state_nolock()) 000000005f38358a lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787380189.357310:0:3638:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007773f658): req@000000003386c46b x1874203867361920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380189.357407:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000173caddd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867361664:0@lo:400: 00000100:00100000:3.0:1787380189.357568:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380189.357604:0:7829:0:(client.c:2702:ptlrpc_set_wait()) set 000000007773f658 going to sleep for 11 seconds 00000100:00100000:1.0:1787380189.357720:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867361920 00000100:00100000:1.0:1787380189.357727:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867361920 00000100:00100000:1.0:1787380189.357769:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787380189.357775:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055eb476e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7829:x1874203867361920:12345-0@lo:1000: 00000100:00100000:1.0:1787380189.357854:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055eb476e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7829:x1874203867361920:12345-0@lo:1000: Request processed in 80us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380189.357873:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787380189.357982:0:7829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003386c46b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874203867361920:0@lo:1000: 00000040:01000000:3.0:1787380189.358018:0:7829:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787380189.358045:0:7829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c21bed6e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874203867362432:0@lo:1000: 00000100:00100000:3.0:1787380189.358073:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380189.358093:0:7829:0:(client.c:2702:ptlrpc_set_wait()) set 00000000331fafc1 going to sleep for 11 seconds 00000100:00100000:1.0:1787380189.358135:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867362432 00000100:00100000:1.0:1787380189.358140:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867362432 00000100:00100000:1.0:1787380189.358168:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787380189.358174:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070ec2ee0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7829:x1874203867362432:12345-0@lo:1000: 00000100:00100000:1.0:1787380189.358268:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070ec2ee0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7829:x1874203867362432:12345-0@lo:1000: Request processed in 95us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380189.358275:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787380189.358341:0:7829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c21bed6e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874203867362432:0@lo:1000: 00000100:00100000:3.0:1787380189.358377:0:7829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c21bed6e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874203867362560:0@lo:700: 00000100:00100000:3.0:1787380189.358402:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380189.358424:0:7829:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b368576c going to sleep for 11 seconds 00000100:00100000:1.0:1787380189.358513:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867362560 00000100:00100000:1.0:1787380189.358518:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867362560 00000100:00100000:1.0:1787380189.358552:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787380189.358558:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc15ef40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7829:x1874203867362560:12345-0@lo:700: 00000100:00100000:1.0:1787380189.358595:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc15ef40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7829:x1874203867362560:12345-0@lo:700: Request processed in 38us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380189.358600:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787380189.358723:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000de9b5db pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867361408:0@lo:38: 00000100:00100000:3.0:1787380189.358787:0:7829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c21bed6e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874203867362560:0@lo:700: 00000100:00100000:3.0:1787380189.359039:0:7829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c21bed6e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874203867362688:0@lo:1000: 00000100:00100000:3.0:1787380189.359067:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380189.359090:0:7829:0:(client.c:2702:ptlrpc_set_wait()) set 000000006d11c908 going to sleep for 11 seconds 00000100:00100000:1.0:1787380189.359138:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867362688 00000100:00100000:1.0:1787380189.359142:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867362688 00000100:00100000:1.0:1787380189.359174:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787380189.359181:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000191ef8aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7829:x1874203867362688:12345-0@lo:1000: 00000100:00100000:1.0:1787380189.359234:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000191ef8aa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7829:x1874203867362688:12345-0@lo:1000: Request processed in 54us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380189.359240:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787380189.359339:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867362816:0@lo:41: 00000100:00100000:0.0:1787380189.359371:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380189.359448:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867362816 00000100:00100000:1.0:1787380189.359453:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867362816 00000100:00100000:1.0:1787380189.359470:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787380189.359475:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd242633 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1874203867362816:12345-0@lo:41: 00000004:00000024:1.0:1787380189.359494:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787380189.359535:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd242633 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1874203867362816:12345-0@lo:41: Request processed in 60us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380189.359542:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787380189.359702:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b3536ca0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867362816:0@lo:41: 00000100:00100000:2.0:1787380189.359785:0:7829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c21bed6e pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874203867362688:0@lo:1000: 00000004:00080000:2.0:1787380189.359871:0:7829:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000b368576c with version 0 00000020:00100000:2.0:1787380189.359948:0:7829:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787380189.359954:0:7829:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000307d9fc8 x1874203867363072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787380189.359968:0:7829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000307d9fc8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874203867363072:0@lo:1000: 00000100:00100000:2.0:1787380189.360002:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380189.360014:0:7829:0:(client.c:2702:ptlrpc_set_wait()) set 000000000f6e7aa6 going to sleep for 11 seconds 00000100:00100000:1.0:1787380189.360123:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867363072 00000100:00100000:1.0:1787380189.360127:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867363072 00000100:00100000:1.0:1787380189.360158:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787380189.360163:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015a5669c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7829:x1874203867363072:12345-0@lo:1000: 00000001:00080000:0.0:1787380189.371006:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1787380189.371019:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787380189.372545:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015a5669c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7829:x1874203867363072:12345-0@lo:1000: Request processed in 12375us (12536us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787380189.372560:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1787380189.372689:0:7829:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1787380189.372694:0:7829:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787380189.372708:0:7829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000307d9fc8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874203867363072:0@lo:1000: 00000100:00100000:2.0:1787380189.372794:0:7829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000307d9fc8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874203867363200:0@lo:1000: 00000100:00100000:2.0:1787380189.372849:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380189.372898:0:7829:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b98a1892 going to sleep for 11 seconds 00000100:00100000:3.0:1787380189.373010:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867363200 00000100:00100000:3.0:1787380189.373018:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867363200 00000100:00100000:3.0:1787380189.373060:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787380189.373067:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f88a4467 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7829:x1874203867363200:12345-0@lo:1000: 00000100:00100000:3.0:1787380189.373137:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f88a4467 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7829:x1874203867363200:12345-0@lo:1000: Request processed in 71us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380189.373144:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787380189.373213:0:7829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000307d9fc8 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7829:1874203867363200:0@lo:1000: 00000040:00080000:0.0:1787380189.373229:0:7829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1787380189.373258:0:7829:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000a2a406ff with version 1 00000004:00080000:3.0:1787380189.375020:0:7827:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000237cc8ed version 1 rpc_version 1 00000020:00100000:3.0:1787380189.375053:0:7827:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787380189.375062:0:7827:0:(client.c:807:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000005b0729ba x1874203867363456/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787380189.375082:0:7827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005b0729ba pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7827:1874203867363456:0@lo:1000: 00000100:00100000:3.0:1787380189.375136:0:7827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380189.375184:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867363456 00000100:00100000:3.0:1787380189.375190:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867363456 00000100:00100000:3.0:1787380189.375222:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787380189.375229:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c1a6732 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7827:x1874203867363456:12345-0@lo:1000: 00000100:00100000:3.0:1787380189.375348:0:7827:0:(client.c:2702:ptlrpc_set_wait()) set 000000002bc4846e going to sleep for 11 seconds 00000040:00080000:0.0:1787380189.377656:0:7829:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787380189.377740:0:7829:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787380189.377745:0:7829:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1787380189.386402:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1787380189.387077:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c1a6732 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7827:x1874203867363456:12345-0@lo:1000: Request processed in 11845us (11938us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787380189.387091:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:2.0:1787380189.387154:0:7827:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1787380189.387158:0:7827:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787380189.387172:0:7827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005b0729ba pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7827:1874203867363456:0@lo:1000: 00010000:00010000:1.0:1787380190.284014:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787380190.893271:0:7879:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787380190.893486:0:7879:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787380191.307995:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787380191.734015:0:7927:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffeaf981040 00000020:00000080:2.0:1787380191.734031:0:7927:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787380191.734036:0:7927:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787380191.734044:0:7927:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeaf9832d0 20000000:00000080:2.0:1787380191.734050:0:7927:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d6ff58a6000 uarg=0000000000000000 20000000:01000000:2.0:1787380191.734088:0:7927:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787380191.734094:0:7927:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787380191.734098:0:7927:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787380191.734164:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787380191.734174:0:7927:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787380191.738020:0:7927:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787380191.738237:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787380191.738268:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787380191.738283:0:7927:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787380191.738298:0:7927:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787380191.738315:0:7927:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000068ef8694/0xcf3c46fdcad68a25 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380191.738343:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b5d3b5dc/0xcf3c46fdcad688a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6889d expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380191.738350:0:7927:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a0e8b5da/0xcf3c46fdcad68992 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6898b expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380191.738356:0:7927:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000068ef8694/0xcf3c46fdcad68a25 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380191.738391:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a0e8b5da/0xcf3c46fdcad68992 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad6898b expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380191.738408:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a0e8b5da/0xcf3c46fdcad68992 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad6898b expref: 17 pid: 6516 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380191.738421:0:7927:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000375ead8c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874203867363584:0@lo:104: 00000100:00100000:2.0:1787380191.738481:0:7927:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380191.738720:0:7927:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b5d3b5dc/0xcf3c46fdcad688a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad6889d expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380191.738739:0:7927:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b5d3b5dc/0xcf3c46fdcad688a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad6889d expref: 17 pid: 6513 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380191.738746:0:7927:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000e83106b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874203867363712:0@lo:104: 00000100:00100000:2.0:1787380191.738767:0:7927:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ec18db19 going to sleep for 11 seconds 00000100:00100000:2.0:1787380191.740284:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787380191.740316:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380191.740347:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867363584 00000100:00100000:2.0:1787380191.740354:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867363584 00000100:00100000:2.0:1787380191.740396:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867363712 00000100:00100000:2.0:1787380191.740400:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867363712 00000100:00100000:2.0:1787380191.740413:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787380191.740419:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d682008 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:7927:x1874203867363584:12345-0@lo:104: 00010000:00010000:2.0:1787380191.740431:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: 00000000b51d605c/0xcf3c46fdcad6898b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68992 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380191.740493:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787380191.740498:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d682008 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:7927:x1874203867363584:12345-0@lo:104: Request processed in 79us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380191.740504:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787380191.740536:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787380191.740542:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007f19335 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:7927:x1874203867363712:12345-0@lo:104: 00010000:00010000:2.0:1787380191.740547:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: 00000000f5a28039/0xcf3c46fdcad6889d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad688a4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380191.740575:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787380191.740578:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007f19335 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:7927:x1874203867363712:12345-0@lo:104: Request processed in 38us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380191.740583:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1787380191.740735:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787380191.740739:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: 00000000b51d605c/0xcf3c46fdcad6898b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68992 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380191.740747:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b51d605c already unused, calling callback (00000000a6065147) 10000000:00010000:3.0:1787380191.740750:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: 00000000b51d605c/0xcf3c46fdcad6898b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68992 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380191.740757:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: 00000000b51d605c/0xcf3c46fdcad6898b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68992 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380191.740764:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: 00000000b51d605c/0xcf3c46fdcad6898b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68992 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380191.740769:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787380191.740922:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: 00000000b51d605c/0xcf3c46fdcad6898b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68992 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380191.740929:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380191.740945:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: 00000000b51d605c/0xcf3c46fdcad6898b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68992 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380191.740961:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: 00000000b51d605c/0xcf3c46fdcad6898b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68992 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380191.740971:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380191.740974:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: 00000000f5a28039/0xcf3c46fdcad6889d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad688a4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380191.740979:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f5a28039 already unused, calling callback (00000000a6065147) 10000000:00010000:3.0:1787380191.740981:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: 00000000f5a28039/0xcf3c46fdcad6889d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad688a4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380191.740987:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: 00000000f5a28039/0xcf3c46fdcad6889d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad688a4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380191.740992:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: 00000000f5a28039/0xcf3c46fdcad6889d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad688a4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380191.740997:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787380191.741043:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000057be9c2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867363840:0@lo:103: 00000100:00100000:2.0:1787380191.741075:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380191.741118:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867363840 00000100:00100000:2.0:1787380191.741122:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867363840 00010000:00010000:2.0:1787380191.741137:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a0e8b5da/0xcf3c46fdcad68992 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6898b expref: 18 pid: 6516 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380191.741156:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787380191.741160:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003df9ecb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:3639:x1874203867363840:12345-0@lo:103: 00010000:00010000:2.0:1787380191.741174:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380191.741178:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a0e8b5da/0xcf3c46fdcad68992 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6898b expref: 18 pid: 6516 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380191.741192:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a0e8b5da/0xcf3c46fdcad68992 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad6898b expref: 18 pid: 6516 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380191.741206:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380191.741230:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003df9ecb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:3639:x1874203867363840:12345-0@lo:103: Request processed in 70us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380191.741236:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787380191.741267:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000057be9c2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867363840:0@lo:103: 00010000:00010000:2.0:1787380191.741907:0:7927:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a0e8b5da/0xcf3c46fdcad68992 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad6898b expref: 17 pid: 6516 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380191.741920:0:7927:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000375ead8c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874203867363584:0@lo:104: 00000100:00100000:2.0:1787380191.741929:0:7927:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000e83106b pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7927:1874203867363712:0@lo:104: 00010000:00010000:2.0:1787380191.741943:0:7927:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000068ef8694/0xcf3c46fdcad68a25 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380191.742401:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: 00000000f5a28039/0xcf3c46fdcad6889d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad688a4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380191.742410:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380191.742421:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: 00000000f5a28039/0xcf3c46fdcad6889d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad688a4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380191.742427:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: 00000000f5a28039/0xcf3c46fdcad6889d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad688a4 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380191.742442:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380191.742452:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380191.742453:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380191.742460:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380191.742471:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a333557e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867363968:0@lo:103: 00000100:00100000:3.0:1787380191.742510:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787380191.743221:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380191.743349:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867363968 00000100:00100000:1.0:1787380191.743357:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867363968 00010000:00010000:1.0:1787380191.743383:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b5d3b5dc/0xcf3c46fdcad688a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6889d expref: 17 pid: 6513 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380191.743416:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787380191.743424:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000961de3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:3639:x1874203867363968:12345-0@lo:103: 00010000:00010000:1.0:1787380191.743435:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380191.743438:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b5d3b5dc/0xcf3c46fdcad688a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6889d expref: 17 pid: 6513 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380191.743454:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b5d3b5dc/0xcf3c46fdcad688a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad6889d expref: 17 pid: 6513 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380191.743467:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b5d3b5dc/0xcf3c46fdcad688a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad6889d expref: 17 pid: 6513 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380191.743479:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000068ef8694/0xcf3c46fdcad68a25 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380191.743485:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068ef8694/0xcf3c46fdcad68a25 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380191.743506:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000068ef8694/0xcf3c46fdcad68a25 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380191.743511:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000068ef8694/0xcf3c46fdcad68a25 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380191.743517:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000068ef8694/0xcf3c46fdcad68a25 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380191.743523:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000068ef8694/0xcf3c46fdcad68a25 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380191.743528:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068ef8694 already unused, calling callback (00000000e476b6df) 00010000:00010000:1.0:1787380191.743531:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000068ef8694/0xcf3c46fdcad68a25 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380191.743537:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000068ef8694/0xcf3c46fdcad68a25 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380191.744971:0:7927:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000068ef8694/0xcf3c46fdcad68a25 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380191.744984:0:7927:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000068ef8694/0xcf3c46fdcad68a25 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380191.749344:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000068ef8694/0xcf3c46fdcad68a25 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380191.749365:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000068ef8694/0xcf3c46fdcad68a25 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7927 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380191.749923:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380191.750007:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000961de3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:3639:x1874203867363968:12345-0@lo:103: Request processed in 6582us (7494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380191.750017:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787380191.750198:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a333557e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867363968:0@lo:103: 00010000:00010000:0.0:1787380192.338878:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380192.909971:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000e83106b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867364096:0@lo:41: 00000100:00100000:0.0:1787380192.910039:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380192.910262:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867364096 00000100:00100000:3.0:1787380192.910270:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867364096 00000100:00100000:3.0:1787380192.910323:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787380192.910331:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3536ca0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867364096:12345-0@lo:41: 00000004:00000024:3.0:1787380192.910362:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1787380192.919487:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3536ca0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867364096:12345-0@lo:41: Request processed in 9147us (9438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380192.919503:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787380192.919724:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000e83106b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867364096:0@lo:41: 00010000:00010000:1.0:1787380193.362506:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380194.380975:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380194.444072:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380194.444093:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003854025d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867364224:0@lo:41: 00000100:00100000:0.0:1787380194.444158:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380194.444286:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867364224 00000100:00100000:1.0:1787380194.444293:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867364224 00000100:00100000:1.0:1787380194.444335:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787380194.444341:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000173caddd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867364224:12345-0@lo:41: 00000004:00000024:1.0:1787380194.444373:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1787380194.444423:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000173caddd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867364224:12345-0@lo:41: Request processed in 82us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380194.444429:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787380194.444722:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000375ead8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867364352:0@lo:400: 00000100:00100000:1.0:1787380194.444756:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380194.445231:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003854025d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867364224:0@lo:41: 00000100:00100000:0.0:1787380194.445251:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000e83106b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867364608:0@lo:400: 00000100:00100000:0.0:1787380194.445280:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380194.445344:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867364608 00000100:00100000:2.0:1787380194.445349:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867364608 00000100:00100000:2.0:1787380194.445375:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787380194.445388:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003854025d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867364608:12345-0@lo:400: 00000100:00100000:2.0:1787380194.445436:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003854025d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867364608:12345-0@lo:400: Request processed in 49us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380194.445442:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787380194.445723:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380194.445731:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c6f8a628 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867364480:0@lo:400: 00000100:00100000:1.0:1787380194.445757:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380194.445854:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867364352 00000100:00100000:1.0:1787380194.445858:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867364352 00000100:00100000:1.0:1787380194.445903:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787380194.445910:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfaa5ef0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:3639:x1874203867364352:12345-0@lo:400: 00000100:00100000:1.0:1787380194.445944:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfaa5ef0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:3639:x1874203867364352:12345-0@lo:400: Request processed in 35us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380194.445949:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787380194.445978:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000307d9fc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867364736:0@lo:400: 00000100:00100000:1.0:1787380194.446136:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380194.446200:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000e83106b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867364608:0@lo:400: 00000100:00100000:1.0:1787380194.446738:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000375ead8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867364352:0@lo:400: 00000100:00100000:2.0:1787380194.447115:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867364480 00000100:00100000:2.0:1787380194.447122:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867364480 00000100:00100000:2.0:1787380194.447261:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867364736 00000100:00100000:2.0:1787380194.447265:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867364736 00000100:00100000:0.0:1787380194.447303:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787380194.447311:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064ad054a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867364480:12345-0@lo:400: 00000100:00100000:0.0:1787380194.447368:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064ad054a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867364480:12345-0@lo:400: Request processed in 58us (1610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380194.447374:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787380194.447388:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787380194.447393:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006e15076 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867364736:12345-0@lo:400: 00000100:00100000:0.0:1787380194.447436:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006e15076 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867364736:12345-0@lo:400: Request processed in 43us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380194.447442:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787380194.447707:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000c6f8a628 x1874203867364480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380194.447719:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c6f8a628 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867364480:0@lo:400: 00010000:00080000:0.0:1787380194.447744:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000307d9fc8 x1874203867364736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380194.447752:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000307d9fc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867364736:0@lo:400: 00010000:00010000:3.0:1787380195.405369:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380196.428062:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380197.474258:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380198.030789:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006b69e559 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867364864:0@lo:41: 00000100:00100000:1.0:1787380198.030892:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380198.031095:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867364864 00000100:00100000:3.0:1787380198.031103:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867364864 00000100:00100000:3.0:1787380198.031141:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787380198.031148:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0374a0a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867364864:12345-0@lo:41: 00000004:00000024:3.0:1787380198.031178:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1787380198.031237:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0374a0a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867364864:12345-0@lo:41: Request processed in 90us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380198.031245:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787380198.031409:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006b69e559 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867364864:0@lo:41: 00010000:00010000:0.0:1787380198.476155:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787380198.539894:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787380198.539901:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ff3dad800 from 1 10000000:01000000:0.0:1787380198.539906:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787380198.539945:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: 00000000d6e0cc3b/0xcf3c46fdcad68a2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380198.539957:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: 00000000d6e0cc3b/0xcf3c46fdcad68a2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380198.539966:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: 00000000d6e0cc3b/0xcf3c46fdcad68a2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380198.539986:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000aa10042 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867364992:0@lo:101: 00000100:00100000:0.0:1787380198.540045:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380198.540166:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 0000000086363bcb going to sleep for 11 seconds 00000100:00100000:2.0:1787380198.545213:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867364992 00000100:00100000:2.0:1787380198.545227:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867364992 00000100:00100000:3.0:1787380198.545768:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787380198.545777:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fff365e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867364992:12345-0@lo:101: 00010000:00010000:3.0:1787380198.545793:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380198.545844:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008ac691c6/0xcf3c46fdcad68a33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68a2c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380198.545871:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008ac691c6/0xcf3c46fdcad68a33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a2c expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380198.545882:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008ac691c6/0xcf3c46fdcad68a33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a2c expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380198.545891:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008ac691c6, rc 0) 00000100:00100000:3.0:1787380198.545958:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fff365e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867364992:12345-0@lo:101: Request processed in 182us (5913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380198.545965:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787380198.545982:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000aa10042 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867364992:0@lo:101: 00010000:00010000:1.0:1787380198.545998:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: 00000000d6e0cc3b/0xcf3c46fdcad68a2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68a33 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380198.546006:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: 00000000d6e0cc3b/0xcf3c46fdcad68a2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68a33 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380198.546228:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a92c2b9b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867365120:0@lo:501: 00000100:00100000:1.0:1787380198.546259:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380198.546297:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 0000000090ab15b6 going to sleep for 11 seconds 00000100:00100000:3.0:1787380198.546542:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867365120 00000100:00100000:3.0:1787380198.546548:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867365120 00000100:00100000:3.0:1787380198.546580:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787380198.546586:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf9d143c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867365120:12345-0@lo:501: 00000100:00100000:3.0:1787380198.546711:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf9d143c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867365120:12345-0@lo:501: Request processed in 125us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380198.546717:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787380198.546746:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a92c2b9b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867365120:0@lo:501: 00000100:00100000:3.0:1787380198.546773:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a333557e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867365248:0@lo:503: 00000100:00100000:3.0:1787380198.546837:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380198.546855:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d109bab7 going to sleep for 11 seconds 00000100:00100000:3.0:1787380198.546865:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867365248 00000100:00100000:3.0:1787380198.546869:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867365248 00000100:00100000:3.0:1787380198.546886:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787380198.546890:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4d13452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867365248:12345-0@lo:503: 00000100:00100000:3.0:1787380198.546963:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4d13452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867365248:12345-0@lo:503: Request processed in 72us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380198.546969:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787380198.547000:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a333557e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867365248:0@lo:503: 00000100:00100000:3.0:1787380198.547370:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a333557e pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8297:1874203867365376:0@lo:502: 00000100:00100000:3.0:1787380198.547519:0:8297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380198.547539:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867365376 00000100:00100000:3.0:1787380198.547542:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867365376 00000100:00100000:3.0:1787380198.547558:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787380198.547562:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2bbb8c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:8297:x1874203867365376:12345-0@lo:502: 00000100:00100000:3.0:1787380198.547713:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2bbb8c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:8297:x1874203867365376:12345-0@lo:502: Request processed in 150us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380198.547719:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787380198.547743:0:8297:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ad3eb3eb going to sleep for 11 seconds 00000100:00100000:3.0:1787380198.547754:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a333557e pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8297:1874203867365376:0@lo:502: 00000020:01000000:3.0:1787380198.547770:0:8297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380198.547778:0:8297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380198.547780:0:8297:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787380198.547786:0:8297:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6ff3dad800 00000020:00000080:3.0:1787380198.547788:0:8297:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787380198.547853:0:8297:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ffaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8297:1874203867365504:0@lo:502: 00000100:00100000:3.0:1787380198.547882:0:8297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380198.547898:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867365504 00000100:00100000:3.0:1787380198.547901:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867365504 00000100:00100000:3.0:1787380198.547916:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787380198.547921:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:8297:x1874203867365504:12345-0@lo:502: 00000100:00100000:3.0:1787380198.547976:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:8297:x1874203867365504:12345-0@lo:502: Request processed in 54us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380198.547982:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787380198.548011:0:8297:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb62fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380198.548571:0:8297:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ffaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8297:1874203867365504:0@lo:502: 00000020:01000000:3.0:1787380198.551739:0:8297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380198.551757:0:8297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380198.551760:0:8297:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787380198.551765:0:8297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1787380198.551992:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787380198.552016:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787380198.552026:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031c00/0xcf3c46fdcad68a2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68a33 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380198.552037:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031c00/0xcf3c46fdcad68a2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68a33 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380198.552048:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787380198.552050:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fc873b000 from 1 10000000:01000000:2.0:1787380198.552053:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787380198.552105:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89dc00/0xcf3c46fdcad68a3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380198.552112:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89dc00/0xcf3c46fdcad68a3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380198.552123:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89dc00/0xcf3c46fdcad68a3a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380198.552148:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867365632:0@lo:101: 00000100:00100000:2.0:1787380198.552240:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380198.552296:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd27a83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380198.552533:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867365632 00000100:00100000:3.0:1787380198.552541:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867365632 00000100:00100000:3.0:1787380198.552594:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787380198.552603:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867365632:12345-0@lo:101: 00010000:00010000:3.0:1787380198.552615:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380198.552626:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9be00/0xcf3c46fdcad68a41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68a3a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380198.552648:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9be00/0xcf3c46fdcad68a41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a3a expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380198.552658:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9be00/0xcf3c46fdcad68a41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a3a expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380198.552666:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9be00, rc 0) 00000100:00100000:3.0:1787380198.552701:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867365632:12345-0@lo:101: Request processed in 100us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380198.552708:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787380198.554726:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867365632:0@lo:101: 00010000:00010000:2.0:1787380198.554752:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89dc00/0xcf3c46fdcad68a3a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380198.554775:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89dc00/0xcf3c46fdcad68a3a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380198.554880:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867365760:0@lo:501: 00000100:00100000:2.0:1787380198.554941:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380198.554975:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd27a83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380198.555183:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867365760 00000100:00100000:1.0:1787380198.555190:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867365760 00000100:00100000:1.0:1787380198.555232:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787380198.555240:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867365760:12345-0@lo:501: 00000100:00100000:1.0:1787380198.555350:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867365760:12345-0@lo:501: Request processed in 110us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380198.555357:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787380198.555869:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867365760:0@lo:501: 00000100:00100000:2.0:1787380198.555902:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867365888:0@lo:503: 00000100:00100000:2.0:1787380198.555946:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380198.555976:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd27a83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380198.556158:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867365888 00000100:00100000:1.0:1787380198.556164:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867365888 00000100:00100000:1.0:1787380198.556199:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787380198.556207:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867365888:12345-0@lo:503: 00000100:00100000:1.0:1787380198.556299:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867365888:12345-0@lo:503: Request processed in 93us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380198.556306:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787380198.556378:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867365888:0@lo:503: 00000100:00100000:3.0:1787380198.556949:0:8298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ffaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8298:1874203867366016:0@lo:502: 00000100:00100000:3.0:1787380198.556989:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380198.557010:0:8298:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb62f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787380198.557165:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867366016 00000100:00100000:1.0:1787380198.557171:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867366016 00000100:00100000:1.0:1787380198.557206:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787380198.557220:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:8298:x1874203867366016:12345-0@lo:502: 00000100:00100000:1.0:1787380198.557299:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:8298:x1874203867366016:12345-0@lo:502: Request processed in 78us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380198.557306:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787380198.557397:0:8298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ffaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8298:1874203867366016:0@lo:502: 00000020:01000000:3.0:1787380198.557419:0:8298:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380198.557427:0:8298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380198.557429:0:8298:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787380198.557435:0:8298:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6fc873b000 00000020:00000080:3.0:1787380198.557437:0:8298:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787380198.557458:0:8298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ffaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8298:1874203867366144:0@lo:502: 00000100:00100000:3.0:1787380198.557489:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380198.557509:0:8298:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb62f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787380198.557975:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867366144 00000100:00100000:1.0:1787380198.557981:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867366144 00000100:00100000:1.0:1787380198.558012:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787380198.558028:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:8298:x1874203867366144:12345-0@lo:502: 00000100:00100000:1.0:1787380198.558115:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:8298:x1874203867366144:12345-0@lo:502: Request processed in 96us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380198.558121:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787380198.558267:0:8298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ffaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8298:1874203867366144:0@lo:502: 00000020:01000000:3.0:1787380198.558288:0:8298:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380198.558293:0:8298:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380198.558295:0:8298:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787380198.558298:0:8298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787380198.558716:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787380198.558739:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787380198.558749:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89dc00/0xcf3c46fdcad68a3a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380198.558760:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89dc00/0xcf3c46fdcad68a3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380199.500166:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380199.566470:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867366656:0@lo:400: 00000100:00100000:1.0:1787380199.566532:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380199.566595:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787380199.566603:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867366272:0@lo:400: 00000100:00100000:1.0:1787380199.566973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380199.566996:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867366784:0@lo:400: 00000100:00100000:1.0:1787380199.567038:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380199.567067:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867366528:0@lo:400: 00000100:00100000:1.0:1787380199.567109:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380199.567130:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787380199.567136:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867366400:0@lo:400: 00000100:00100000:1.0:1787380199.567158:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380199.567185:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867366656 00000100:00100000:1.0:1787380199.567203:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867366656 00000100:00100000:1.0:1787380199.567245:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867366400 00000100:00100000:1.0:1787380199.567248:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867366400 00000100:00100000:1.0:1787380199.567263:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787380199.567269:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867366656:12345-0@lo:400: 00000100:00100000:1.0:1787380199.567329:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867366656:12345-0@lo:400: Request processed in 59us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380199.567336:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787380199.567352:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787380199.567357:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867366400:12345-0@lo:400: 00000100:00100000:1.0:1787380199.567715:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867366400:12345-0@lo:400: Request processed in 356us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380199.567721:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787380199.567741:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867366784 00000100:00100000:1.0:1787380199.567745:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867366784 00000100:00100000:1.0:1787380199.567763:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867366528 00000100:00100000:1.0:1787380199.567765:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867366528 00000100:00100000:1.0:1787380199.567777:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787380199.567783:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867366784:12345-0@lo:400: 00000100:00100000:1.0:1787380199.567843:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867366784:12345-0@lo:400: Request processed in 60us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380199.567849:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787380199.567861:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787380199.567874:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867366528:12345-0@lo:400: 00000100:00100000:1.0:1787380199.567902:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867366528:12345-0@lo:400: Request processed in 29us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380199.567907:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787380199.567949:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fc43ea680 x1874203867366400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380199.567962:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867366400:0@lo:400: 00000100:00100000:1.0:1787380199.567973:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867366528:0@lo:400: 00000100:00100000:1.0:1787380199.568001:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867366784:0@lo:400: 00010000:00080000:1.0:1787380199.568011:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fc43eaa00 x1874203867366656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380199.568019:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867366656:0@lo:400: 00000100:00100000:2.0:1787380199.568133:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867366272 00000100:00100000:2.0:1787380199.568138:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867366272 00000100:00100000:2.0:1787380199.568172:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787380199.568179:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:3639:x1874203867366272:12345-0@lo:400: 00000100:00100000:2.0:1787380199.568227:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:3639:x1874203867366272:12345-0@lo:400: Request processed in 48us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380199.568234:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787380199.568267:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867366272:0@lo:400: 00000100:00100000:2.0:1787380199.570571:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787380199.570595:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867366912:0@lo:41: 00000100:00100000:2.0:1787380199.570769:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380199.570881:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867366912 00000100:00100000:3.0:1787380199.570888:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867366912 00000100:00100000:3.0:1787380199.570933:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787380199.570941:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867366912:12345-0@lo:41: 00000004:00000024:3.0:1787380199.570971:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1787380199.571013:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867366912:12345-0@lo:41: Request processed in 73us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380199.571020:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787380199.572324:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867366912:0@lo:41: 00010000:00010000:2.0:1787380200.526463:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787380200.721767:0:8427:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787380200.721771:0:8427:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787380200.721773:0:8427:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787380200.722047:0:8427:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d6ff5cad800 00000020:01000004:1.0:1787380200.722063:0:8427:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787380200.722073:0:8427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787380200.722158:0:8427:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9d6ffc73b380) 00000020:00000080:1.0:1787380200.722177:0:8427:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787380200.768117:0:8427:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787380200.771281:0:8427:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1787380200.792308:0:8427:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787380200.792686:0:8427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787380200.792697:0:8427:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787380200.792707:0:8427:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf3c46fdcad68a4f 00000020:01000004:3.0:1787380200.792712:0:8427:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787380200.792730:0:8427:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.130@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787380200.792733:0:8427:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787380200.792739:0:8427:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787380200.792743:0:8427:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787380200.792760:0:8427:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9d6ffc9599c0) 00000020:00000080:3.0:1787380200.792772:0:8427:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1787380200.794359:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787380200.794501:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787380200.794508:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787380200.806435:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787380200.806447:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787380200.809406:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787380200.809417:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787380200.816350:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787380200.816521:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787380200.816527:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787380200.817603:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787380200.817612:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787380200.835532:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787380200.835715:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787380200.835720:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787380200.837467:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787380200.837481:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787380200.838743:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787380200.838753:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787380200.840940:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787380200.841102:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787380200.841107:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787380200.841643:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787380200.841650:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787380200.881421:0:8427:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787380200.881594:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787380200.881600:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787380200.883979:0:8427:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787380200.883997:0:8427:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787380200.884533:0:8427:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787380200.884561:0:8427:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1787380200.884567:0:8427:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787380200.899254:0:8427:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787380200.900097:0:8427:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.130@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787380200.900105:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787380200.900106:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787380200.900108:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380200.900109:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380200.900110:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380200.900112:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380200.900113:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787380200.900115:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787380200.900116:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787380200.900118:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380200.900119:0:8427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787380200.900122:0:8427:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787380200.900124:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787380200.900126:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787380200.900127:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380200.900210:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380200.900211:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380200.900212:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380200.900214:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787380200.900215:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787380200.900216:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787380200.900217:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380200.900218:0:8427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787380200.900244:0:8427:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787380200.900262:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867367040:0@lo:253: 00000100:00100000:1.0:1787380200.900331:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380200.900467:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867367040 00000100:00100000:2.0:1787380200.900477:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867367040 00000100:00100000:2.0:1787380200.900531:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787380200.900541:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:8427:x1874203867367040:12345-0@lo:253: 20000000:01000000:2.0:1787380200.900572:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787380200.900577:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787380200.900583:0:6513:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787380200.900586:0:6513:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787380200.900894:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787380200.901063:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1787380200.901076:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787380200.901093:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1787380200.901099:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787380200.901111:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1787380200.901123:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000100:00100000:1.0:1787380200.901227:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576780 going to sleep for 11 seconds 00000040:00080000:2.0:1787380200.901469:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1787380200.901483:0:6513:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.206.130@tcp 20000000:01000000:2.0:1787380200.901485:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.130@tcp (null) (null) (null) 00000040:00080000:2.0:1787380200.901501:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1787380200.901506:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787380200.901521:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1787380200.901526:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.130@tcp (null) (null) 00000040:00080000:2.0:1787380200.901538:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1787380200.901554:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787380200.901570:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1787380200.901586:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1787380200.901653:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1787380200.901663:0:6513:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.206.130@tcp 20000000:01000000:2.0:1787380200.901665:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.130@tcp (null) (null) (null) 00000040:00080000:2.0:1787380200.901678:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1787380200.901684:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787380200.901695:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1787380200.901700:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.206.130@tcp (null) (null) 00000040:00080000:2.0:1787380200.901710:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1787380200.901714:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787380200.901725:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1787380200.901739:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1787380200.902356:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1787380200.902371:0:6513:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.206.130@tcp 20000000:01000000:2.0:1787380200.902373:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.130@tcp (null) (null) (null) 00000040:00080000:2.0:1787380200.902388:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1787380200.902395:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787380200.902407:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1787380200.902413:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.130@tcp (null) (null) 00000040:00080000:2.0:1787380200.902427:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1787380200.902433:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787380200.902446:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1787380200.902481:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1787380200.902496:0:6513:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787380200.902499:0:6513:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787380200.902502:0:6513:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787380200.902541:0:6513:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787380200.902543:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787380200.903080:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1787380200.903103:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1787380200.903116:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787380200.903383:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787380200.903410:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787380200.903426:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787380200.903435:0:6513:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787380200.903437:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787380200.903678:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:0.0:1787380200.903699:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:0.0:1787380200.903714:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:2.0:1787380200.903932:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:2.0:1787380200.903950:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:2.0:1787380200.903963:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:2.0:1787380200.903970:0:6513:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787380200.903972:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787380200.904324:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787380200.904477:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787380200.904495:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787380200.904511:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787380200.904519:0:6513:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787380200.904521:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787380200.904777:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1787380200.904806:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1787380200.904927:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787380200.905070:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:2.0:1787380200.905086:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:2.0:1787380200.905097:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:2.0:1787380200.905108:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787380200.905125:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad68a5d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.905213:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ffb89de00/0xcf3c46fdcad68929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68922 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.905221:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc0031000/0xcf3c46fdcad689a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68999 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.905228:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc165b000/0xcf3c46fdcad689d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad689d1 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.905235:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc165ae00/0xcf3c46fdcad689f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad689ed expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.905252:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ffb89da00/0xcf3c46fdcad68a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a17 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.905259:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad68a5d lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.905292:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ffb89da00/0xcf3c46fdcad68a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68a17 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.905305:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6ffb89da00/0xcf3c46fdcad68a1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a17 expref: 18 pid: 6515 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380200.905318:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1874203867367168:0@lo:104: 00000100:00100000:2.0:1787380200.905375:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380200.905450:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc165ae00/0xcf3c46fdcad689f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad689ed expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.905458:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc165ae00/0xcf3c46fdcad689f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad689ed expref: 18 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380200.905467:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1874203867367296:0@lo:104: 00000100:00100000:2.0:1787380200.905486:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380200.905596:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc165b000/0xcf3c46fdcad689d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad689d1 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.905605:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc165b000/0xcf3c46fdcad689d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad689d1 expref: 18 pid: 6515 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380200.905614:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1874203867367424:0@lo:104: 00000100:00100000:2.0:1787380200.905637:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380200.905659:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867367168 00000100:00100000:0.0:1787380200.905664:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867367168 00000100:00100000:3.0:1787380200.905705:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867367296 00000100:00100000:3.0:1787380200.905708:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867367296 00000100:00100000:3.0:1787380200.905726:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787380200.905733:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:6513:x1874203867367168:12345-0@lo:104: 00010000:00010000:3.0:1787380200.905743:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68a1e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.905875:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787380200.905881:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:6513:x1874203867367168:12345-0@lo:104: Request processed in 149us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380200.905889:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787380200.905905:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787380200.905911:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:6513:x1874203867367296:12345-0@lo:104: 00010000:00010000:3.0:1787380200.905918:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030400/0xcf3c46fdcad689ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad689f4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.905991:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc0031000/0xcf3c46fdcad689a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68999 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.906000:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc0031000/0xcf3c46fdcad689a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68999 expref: 18 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380200.906008:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1874203867367552:0@lo:104: 00000100:00100000:2.0:1787380200.906026:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380200.906038:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ffb89de00/0xcf3c46fdcad68929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68922 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.906045:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6ffb89de00/0xcf3c46fdcad68929 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68922 expref: 18 pid: 6515 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380200.906053:0:6513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1874203867367680:0@lo:104: 00000100:00100000:2.0:1787380200.906066:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380200.906073:0:6513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd2494000 going to sleep for 11 seconds 00000100:00100000:2.0:1787380200.906089:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1874203867367168:0@lo:104: 00000100:00100000:2.0:1787380200.906096:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1874203867367296:0@lo:104: 00000100:00100000:0.0:1787380200.906172:0:6505:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1787380200.906179:0:6505:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1787380200.906302:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787380200.906309:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68a1e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.906326:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc0031600 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:1.0:1787380200.906330:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68a1e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.906339:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68a1e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380200.906345:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68a1e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380200.906350:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787380200.906383:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68a17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68a1e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.906390:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787380200.906433:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867367808:0@lo:103: 00000100:00100000:2.0:1787380200.906459:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787380200.906537:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68a17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68a1e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.906544:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68a17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68a1e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.906555:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380200.906558:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030400/0xcf3c46fdcad689ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad689f4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.906563:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc0030400 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:1.0:1787380200.906566:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030400/0xcf3c46fdcad689ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad689f4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.906581:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030400/0xcf3c46fdcad689ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad689f4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380200.906587:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030400/0xcf3c46fdcad689ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad689f4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380200.906591:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787380200.906611:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030400/0xcf3c46fdcad689ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad689f4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.906616:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380200.906627:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030400/0xcf3c46fdcad689ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad689f4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.906633:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030400/0xcf3c46fdcad689ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad689f4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.906642:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380200.906644:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380200.906646:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380200.906845:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867367424 00000100:00100000:1.0:1787380200.906850:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867367424 00000100:00100000:1.0:1787380200.906887:0:6505:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1787380200.906893:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867367552 00000100:00100000:1.0:1787380200.906896:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867367552 00000100:00100000:1.0:1787380200.906906:0:6505:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1787380200.906909:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867367680 00000100:00100000:1.0:1787380200.906912:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867367680 00000100:00100000:0.0:1787380200.907016:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787380200.907025:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+6:6513:x1874203867367424:12345-0@lo:104: 00010000:00010000:0.0:1787380200.907033:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c000/0xcf3c46fdcad689d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad689d8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380200.907089:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787380200.907095:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+6:6513:x1874203867367424:12345-0@lo:104: Request processed in 73us (1458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380200.907101:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787380200.907116:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787380200.907122:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:6513:x1874203867367552:12345-0@lo:104: 00000100:00100000:1.0:1787380200.907231:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1874203867367424:0@lo:104: 00010000:00010000:0.0:1787380200.907260:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad689a0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380200.907305:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787380200.907310:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:6513:x1874203867367552:12345-0@lo:104: Request processed in 190us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380200.907316:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787380200.907329:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787380200.907335:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:6513:x1874203867367680:12345-0@lo:104: 00010000:00010000:0.0:1787380200.907342:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68929 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380200.907367:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787380200.907378:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:6513:x1874203867367680:12345-0@lo:104: Request processed in 44us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380200.907384:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1787380200.907427:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787380200.907439:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c000/0xcf3c46fdcad689d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad689d8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.907445:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c000 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:1.0:1787380200.907448:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c000/0xcf3c46fdcad689d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad689d8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.907455:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c000/0xcf3c46fdcad689d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad689d8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380200.907461:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c000/0xcf3c46fdcad689d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad689d8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380200.907466:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787380200.907495:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c000/0xcf3c46fdcad689d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad689d8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.907501:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380200.907508:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c000/0xcf3c46fdcad689d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad689d8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.907514:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c000/0xcf3c46fdcad689d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad689d8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.907524:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787380200.907527:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad689a0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.907532:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9ac00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:1.0:1787380200.907535:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad689a0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.907550:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad689a0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380200.907557:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad689a0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380200.907562:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787380200.907576:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68999 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad689a0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.907581:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787380200.907676:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787380200.907685:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867368192:0@lo:103: 00000100:00100000:2.0:1787380200.907727:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380200.907765:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867367808 00000100:00100000:2.0:1787380200.907770:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867367808 00010000:00010000:2.0:1787380200.907790:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ffb89da00/0xcf3c46fdcad68a1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a17 expref: 19 pid: 6515 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380200.907843:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867368192 00000100:00100000:2.0:1787380200.907847:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867368192 00010000:00010000:2.0:1787380200.907860:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc0031000/0xcf3c46fdcad689a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68999 expref: 20 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380200.907872:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787380200.907878:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:3642:x1874203867367808:12345-0@lo:103: 00010000:00010000:2.0:1787380200.907887:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380200.907892:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ffb89da00/0xcf3c46fdcad68a1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a17 expref: 20 pid: 6515 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.907902:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ffb89da00/0xcf3c46fdcad68a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a17 expref: 20 pid: 6515 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.907916:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffb89da00/0xcf3c46fdcad68a1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68a17 expref: 20 pid: 6515 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.907929:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380200.907957:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:3642:x1874203867367808:12345-0@lo:103: Request processed in 79us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380200.907963:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787380200.907977:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787380200.907983:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:3642:x1874203867368192:12345-0@lo:103: 00010000:00010000:2.0:1787380200.907990:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380200.907994:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc0031000/0xcf3c46fdcad689a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68999 expref: 18 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.908002:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc0031000/0xcf3c46fdcad689a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68999 expref: 18 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.908019:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380200.908042:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:3642:x1874203867368192:12345-0@lo:103: Request processed in 60us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380200.908048:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787380200.908066:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867367936:0@lo:103: 00000100:00100000:2.0:1787380200.908088:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380200.908104:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380200.908111:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867368064:0@lo:103: 00000100:00100000:2.0:1787380200.908335:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380200.908356:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787380200.908382:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867367936 00000100:00100000:2.0:1787380200.908385:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867367936 00010000:00010000:2.0:1787380200.908399:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc165ae00/0xcf3c46fdcad689f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad689ed expref: 18 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380200.908412:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867368064 00000100:00100000:2.0:1787380200.908414:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867368064 00010000:00010000:2.0:1787380200.908422:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc165b000/0xcf3c46fdcad689d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad689d1 expref: 19 pid: 6515 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380200.908432:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787380200.908437:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:3639:x1874203867367936:12345-0@lo:103: 00010000:00010000:2.0:1787380200.908445:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380200.908448:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc165ae00/0xcf3c46fdcad689f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad689ed expref: 19 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.908457:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc165ae00/0xcf3c46fdcad689f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad689ed expref: 19 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.908479:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc165ae00/0xcf3c46fdcad689f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad689ed expref: 19 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.908489:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380200.908518:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:3639:x1874203867367936:12345-0@lo:103: Request processed in 79us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380200.908524:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787380200.908537:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787380200.908543:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:3639:x1874203867368064:12345-0@lo:103: 00010000:00010000:2.0:1787380200.908550:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380200.908555:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc165b000/0xcf3c46fdcad689d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad689d1 expref: 17 pid: 6515 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.908563:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc165b000/0xcf3c46fdcad689d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad689d1 expref: 17 pid: 6515 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.908572:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc165b000/0xcf3c46fdcad689d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad689d1 expref: 17 pid: 6515 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.908580:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380200.908601:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:3639:x1874203867368064:12345-0@lo:103: Request processed in 59us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380200.908607:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787380200.908639:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867368064:0@lo:103: 00000100:00100000:2.0:1787380200.908647:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867367936:0@lo:103: 00000100:00100000:2.0:1787380200.908674:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867368192:0@lo:103: 00000100:00100000:2.0:1787380200.908694:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867367808:0@lo:103: 00010000:00010000:0.0:1787380200.908858:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc0031000/0xcf3c46fdcad689a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68999 expref: 15 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380200.908868:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1874203867367552:0@lo:104: 00000100:00100000:0.0:1787380200.908877:0:6513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6513:1874203867367680:0@lo:104: 00010000:00010000:0.0:1787380200.908898:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad68a5d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.909023:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1787380200.909031:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:6513:x1874203867367296:12345-0@lo:104: Request processed in 3120us (3543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380200.909038:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1787380200.909688:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68999 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad689a0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.909700:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68999 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad689a0 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.909713:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380200.909715:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380200.909717:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380200.909976:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380200.909979:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380200.909981:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380200.910007:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68929 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380200.910015:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc0030200 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:0.0:1787380200.910019:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68929 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380200.910027:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68929 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380200.910033:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68929 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380200.910039:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787380200.910109:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68922 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68929 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380200.910117:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787380200.910218:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867368320:0@lo:103: 00000100:00100000:2.0:1787380200.910267:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380200.910340:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867368320 00000100:00100000:3.0:1787380200.910346:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867368320 00010000:00010000:3.0:1787380200.910367:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ffb89de00/0xcf3c46fdcad68929 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68922 expref: 15 pid: 6515 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380200.910391:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787380200.910399:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:3642:x1874203867368320:12345-0@lo:103: 00010000:00010000:3.0:1787380200.910409:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380200.910413:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ffb89de00/0xcf3c46fdcad68929 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68922 expref: 15 pid: 6515 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.910423:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ffb89de00/0xcf3c46fdcad68929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68922 expref: 15 pid: 6515 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.910436:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffb89de00/0xcf3c46fdcad68929 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68922 expref: 15 pid: 6515 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.910461:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad68a5d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.910482:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad68a5d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.910498:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad68a5d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.910505:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad68a5d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.910512:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad68a5d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.910519:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad68a5d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.910525:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89ca00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:3.0:1787380200.910528:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad68a5d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.910536:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad68a5d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.910550:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad68a5d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.910559:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380200.910602:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68922 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68929 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380200.910614:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68922 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68929 expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380200.910628:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380200.910630:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380200.910631:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380200.910643:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad68a5d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380200.910650:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad68a5d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380200.910657:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad68a5d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787380200.910666:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787380200.911540:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:3642:x1874203867368320:12345-0@lo:103: Request processed in 1137us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380200.911560:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787380200.911640:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867368320:0@lo:103: 00000100:00100000:2.0:1787380200.912865:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+13:8427:x1874203867367040:12345-0@lo:253: Request processed in 12322us (12531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380200.912875:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787380200.913769:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867367040:0@lo:253: 10000000:01000000:1.0:1787380200.913784:0:8427:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787380200.913787:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787380200.913789:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787380200.913790:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380200.913791:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1787380200.913802:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380200.913803:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380200.913805:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787380200.913806:0:8427:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787380200.913833:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380200.913847:0:8427:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787380200.913865:0:8427:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d6ff5cad800 from lustre-OST0000 10000000:01000000:1.0:1787380200.913890:0:8427:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787380200.913893:0:8427:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787380200.913900:0:8427:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d6ff8828000 local copy 10000000:01000000:1.0:1787380200.913903:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787380200.913934:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68a64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.913945:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68a64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.913954:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68a64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380200.913971:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867368448:0@lo:101: 00000100:00100000:1.0:1787380200.914013:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380200.914045:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576540 going to sleep for 11 seconds 00000100:00100000:3.0:1787380200.914110:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867368448 00000100:00100000:3.0:1787380200.914115:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867368448 00000100:00100000:3.0:1787380200.914164:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787380200.914173:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+13:8427:x1874203867368448:12345-0@lo:101: 00010000:00010000:3.0:1787380200.914186:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380200.914198:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad68a6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68a64 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.914219:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad68a6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a64 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.914229:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad68a6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a64 expref: 14 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.914238:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9a000, rc 0) 00000100:00100000:3.0:1787380200.914281:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:8427:x1874203867368448:12345-0@lo:101: Request processed in 109us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380200.914287:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787380200.914403:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867368448:0@lo:101: 00010000:00010000:1.0:1787380200.914415:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68a64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcf3c46fdcad68a6b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.914423:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68a64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf3c46fdcad68a6b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380200.914519:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867368576:0@lo:501: 00000100:00100000:1.0:1787380200.914560:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380200.914583:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576540 going to sleep for 11 seconds 00000100:00100000:3.0:1787380200.914682:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867368576 00000100:00100000:3.0:1787380200.914688:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867368576 00000100:00100000:3.0:1787380200.914717:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787380200.914724:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:8427:x1874203867368576:12345-0@lo:501: 00000100:00100000:3.0:1787380200.914782:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:8427:x1874203867368576:12345-0@lo:501: Request processed in 58us (235us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787380200.914790:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787380200.914970:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867368576:0@lo:501: 10000000:01000000:1.0:1787380200.914981:0:8427:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787380200.915005:0:8427:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787380200.915010:0:8427:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68a64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf3c46fdcad68a6b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.915018:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68a64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf3c46fdcad68a6b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.915025:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68a64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf3c46fdcad68a6b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.915048:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787380200.915067:0:8427:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d6ff5cad800 10000000:01000000:1.0:1787380200.915071:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787380200.915076:0:8427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787380200.915078:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787380200.915082:0:8427:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787380200.915084:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787380200.915100:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ac00/0xcf3c46fdcad68a72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.915107:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ac00/0xcf3c46fdcad68a72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.915114:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ac00/0xcf3c46fdcad68a72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380200.915125:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867368704:0@lo:101: 00000100:00100000:1.0:1787380200.915228:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380200.915256:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380200.915299:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867368704 00000100:00100000:3.0:1787380200.915304:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867368704 00000100:00100000:3.0:1787380200.915341:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787380200.915347:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:8427:x1874203867368704:12345-0@lo:101: 00010000:00010000:3.0:1787380200.915354:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380200.915364:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68a79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68a72 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.915379:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a72 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.915387:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a72 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.915394:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9b800, rc 0) 00000100:00100000:3.0:1787380200.915421:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:8427:x1874203867368704:12345-0@lo:101: Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380200.915427:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:2.0:1787380200.915477:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380200.915483:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68a64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcf3c46fdcad68a6b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.915490:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165b800 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:2.0:1787380200.915494:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68a64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcf3c46fdcad68a6b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.915502:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcf3c46fdcad68a6b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380200.915509:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcf3c46fdcad68a6b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380200.915514:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787380200.915533:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68a64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf3c46fdcad68a6b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.915562:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787380200.915587:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68a64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf3c46fdcad68a6b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.915594:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68a64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf3c46fdcad68a6b expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.915607:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380200.915609:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380200.915610:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380200.915618:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380200.915629:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867368832:0@lo:103: 00000100:00100000:2.0:1787380200.915657:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380200.915683:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867368832 00000100:00100000:2.0:1787380200.915687:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867368832 00000100:00100000:2.0:1787380200.915717:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787380200.915723:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:3640:x1874203867368832:12345-0@lo:103: 00010000:00010000:2.0:1787380200.915744:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380200.915756:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad68a6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad68a64 expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.915766:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380200.915803:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:3640:x1874203867368832:12345-0@lo:103: Request processed in 69us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380200.915834:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787380200.915861:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867368832:0@lo:103: 00000100:00100000:1.0:1787380200.916014:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867368704:0@lo:101: 00010000:00010000:1.0:1787380200.916031:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ac00/0xcf3c46fdcad68a72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68a79 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.916039:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ac00/0xcf3c46fdcad68a72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68a79 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380200.916111:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867368960:0@lo:501: 00000100:00100000:1.0:1787380200.916210:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380200.916240:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380200.916282:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867368960 00000100:00100000:3.0:1787380200.916287:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867368960 00000100:00100000:3.0:1787380200.916315:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787380200.916323:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:8427:x1874203867368960:12345-0@lo:501: 00000100:00100000:3.0:1787380200.916418:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:8427:x1874203867368960:12345-0@lo:501: Request processed in 96us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380200.916425:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787380200.916488:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867368960:0@lo:501: 00000100:00100000:1.0:1787380200.916514:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867369088:0@lo:503: 00000100:00100000:1.0:1787380200.916549:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380200.916601:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380200.917103:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867369088 00000100:00100000:3.0:1787380200.917108:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867369088 00000100:00100000:3.0:1787380200.917241:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787380200.917250:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:8427:x1874203867369088:12345-0@lo:503: 00000100:00100000:3.0:1787380200.917349:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:8427:x1874203867369088:12345-0@lo:503: Request processed in 99us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380200.917360:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787380200.918182:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867369088:0@lo:503: 00000040:00080000:1.0:1787380200.918429:0:8427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787380200.918510:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867369216:0@lo:502: 00000100:00100000:1.0:1787380200.918558:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380200.918585:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576600 going to sleep for 11 seconds 00000100:00100000:2.0:1787380200.918698:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867369216 00000100:00100000:2.0:1787380200.918710:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867369216 00000100:00100000:2.0:1787380200.918757:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787380200.918765:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:8427:x1874203867369216:12345-0@lo:502: 00000100:00100000:2.0:1787380200.918893:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:8427:x1874203867369216:12345-0@lo:502: Request processed in 128us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380200.918900:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787380200.919085:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867369216:0@lo:502: 00000040:00080000:1.0:1787380200.919306:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787380200.919333:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787380200.919349:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787380200.919361:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787380200.919380:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787380200.919396:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787380200.919429:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867369344:0@lo:502: 00000100:00100000:1.0:1787380200.919469:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380200.919499:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380200.919603:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867369344 00000100:00100000:3.0:1787380200.919608:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867369344 00000100:00100000:3.0:1787380200.919646:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787380200.919653:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:8427:x1874203867369344:12345-0@lo:502: 00000100:00100000:3.0:1787380200.919745:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:8427:x1874203867369344:12345-0@lo:502: Request processed in 79us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380200.919752:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787380200.919995:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867369344:0@lo:502: 00000040:00080000:1.0:1787380200.920035:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1787380200.920043:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787380200.920543:0:8452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787380200.920551:0:8452:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1787380200.920557:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380200.920559:0:8452:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787380200.920565:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787380200.920578:0:8452:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9d6ffc95b380) 00000020:00000080:3.0:1787380200.920597:0:8452:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787380200.920603:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787380200.920665:0:8452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6ff5cad800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787380200.920672:0:8452:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787380200.920678:0:8452:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf3c46fdcad68a87 00010000:00010000:3.0:1787380200.927100:0:8452:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1787380200.929505:0:8452:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787380200.934397:0:8452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787380200.935432:0:8452:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787380200.945108:0:8452:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1787380200.945531:0:8452:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1787380200.958064:0:8452:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1787380200.964584:0:8452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787380200.964596:0:8452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380200.964603:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380200.964605:0:8452:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787380200.964609:0:8452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787380200.964612:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380200.964614:0:8452:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787380200.964616:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787380200.964618:0:8452:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787380200.964642:0:8452:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380200.964645:0:8452:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380200.964646:0:8452:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787380200.964649:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787380200.968694:0:8427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787380200.968864:0:8427:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787380200.968884:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ac00/0xcf3c46fdcad68a72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68a79 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.969004:0:8427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ac00/0xcf3c46fdcad68a72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68a79 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380200.969628:0:8427:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ff5cad800 from 1 10000000:01000000:0.0:1787380200.969633:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787380200.969672:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68a8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380200.969681:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68a8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380200.969692:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68a8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380200.969713:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e32300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867369472:0@lo:101: 00000100:00100000:0.0:1787380200.969789:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380200.969904:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380200.970033:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867369472 00000100:00100000:3.0:1787380200.970041:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867369472 00000100:00100000:3.0:1787380200.970089:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787380200.970098:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:8427:x1874203867369472:12345-0@lo:101: 00010000:00010000:3.0:1787380200.970111:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380200.970122:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9aa00/0xcf3c46fdcad68a95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68a8e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.970153:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9aa00/0xcf3c46fdcad68a95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a8e expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.970163:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9aa00/0xcf3c46fdcad68a95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a8e expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.970172:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9aa00, rc 0) 00000100:00100000:3.0:1787380200.970257:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:8427:x1874203867369472:12345-0@lo:101: Request processed in 159us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380200.970264:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787380200.975122:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e32300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867369472:0@lo:101: 00010000:00010000:2.0:1787380200.975151:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68a8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68a95 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.975163:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68a8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68a95 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380200.975274:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867369600:0@lo:501: 00000100:00100000:2.0:1787380200.975328:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380200.975358:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc84c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380200.975416:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867369600 00000100:00100000:3.0:1787380200.975423:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867369600 00000100:00100000:3.0:1787380200.975468:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787380200.975477:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:8427:x1874203867369600:12345-0@lo:501: 00000100:00100000:3.0:1787380200.975596:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:8427:x1874203867369600:12345-0@lo:501: Request processed in 120us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380200.975619:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787380200.975772:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867369600:0@lo:501: 00000100:00100000:2.0:1787380200.975849:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867369728:0@lo:503: 00000100:00100000:2.0:1787380200.975886:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380200.975905:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc84c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380200.975951:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867369728 00000100:00100000:3.0:1787380200.975956:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867369728 00000100:00100000:3.0:1787380200.975991:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787380200.975998:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:8427:x1874203867369728:12345-0@lo:503: 00000100:00100000:3.0:1787380200.976078:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:8427:x1874203867369728:12345-0@lo:503: Request processed in 75us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380200.976086:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787380200.976433:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867369728:0@lo:503: 00000040:00080000:2.0:1787380200.976668:0:8427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787380200.976738:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867369856:0@lo:502: 00000100:00100000:2.0:1787380200.976775:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380200.976831:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc84c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380200.977404:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867369856 00000100:00100000:3.0:1787380200.977410:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867369856 00000100:00100000:3.0:1787380200.977451:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787380200.977458:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:8427:x1874203867369856:12345-0@lo:502: 00000100:00100000:3.0:1787380200.977566:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:8427:x1874203867369856:12345-0@lo:502: Request processed in 108us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380200.977574:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787380200.977715:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867369856:0@lo:502: 00000040:00080000:2.0:1787380200.977995:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787380200.978022:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787380200.978046:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867369984:0@lo:502: 00000100:00100000:2.0:1787380200.978083:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380200.978270:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc84c600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380200.983127:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867369984 00000100:00100000:3.0:1787380200.983141:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867369984 00000100:00100000:2.0:1787380200.983301:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787380200.983312:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:8427:x1874203867369984:12345-0@lo:502: 00000100:00100000:2.0:1787380200.983475:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:8427:x1874203867369984:12345-0@lo:502: Request processed in 164us (5390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380200.983483:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787380200.983600:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867369984:0@lo:502: 00000040:00080000:0.0:1787380200.983679:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787380200.983692:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787380200.984291:0:8456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380200.984299:0:8456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380200.984301:0:8456:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787380200.984308:0:8456:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6ff5cad800 00000020:00000080:0.0:1787380200.984310:0:8456:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787380200.984321:0:8456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380200.984323:0:8456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380200.984324:0:8456:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787380200.984327:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787380200.984438:0:8427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787380200.984462:0:8427:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787380200.984483:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68a8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68a95 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.984493:0:8427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68a8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68a95 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380200.984551:0:8427:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787380200.984554:0:8427:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d6ff5cad800 10000000:01000000:2.0:1787380200.984557:0:8427:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d6ff5cad800 10000000:01000000:2.0:1787380200.984560:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787380200.984565:0:8427:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6ff5cad800 from 1 10000000:01000000:2.0:1787380200.984567:0:8427:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787380200.984592:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68a9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.984600:0:8427:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68a9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380200.984608:0:8427:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68a9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380200.984622:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867370112:0@lo:101: 00000100:00100000:2.0:1787380200.984658:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380200.984691:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc84c300 going to sleep for 11 seconds 00000100:00100000:3.0:1787380200.984788:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867370112 00000100:00100000:3.0:1787380200.984804:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867370112 00000100:00100000:3.0:1787380200.984863:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787380200.984870:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:8427:x1874203867370112:12345-0@lo:101: 00010000:00010000:3.0:1787380200.984881:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380200.984892:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9b400/0xcf3c46fdcad68aa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68a9c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.984912:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9b400/0xcf3c46fdcad68aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a9c expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.984940:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9b400/0xcf3c46fdcad68aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a9c expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380200.984948:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9b400, rc 0) 00000100:00100000:3.0:1787380200.984985:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:8427:x1874203867370112:12345-0@lo:101: Request processed in 116us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380200.984991:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787380200.985074:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867370112:0@lo:101: 00010000:00010000:1.0:1787380200.985085:0:8427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68a9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68aa3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380200.985093:0:8427:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68a9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68aa3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380200.985149:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867370240:0@lo:501: 00000100:00100000:1.0:1787380200.985172:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380200.985192:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc85760c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380200.985238:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867370240 00000100:00100000:3.0:1787380200.985242:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867370240 00000100:00100000:3.0:1787380200.985272:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787380200.985278:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:8427:x1874203867370240:12345-0@lo:501: 00000100:00100000:3.0:1787380200.985366:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:8427:x1874203867370240:12345-0@lo:501: Request processed in 88us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380200.985372:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787380200.985439:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867370240:0@lo:501: 00000100:00100000:1.0:1787380200.985465:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867370368:0@lo:503: 00000100:00100000:1.0:1787380200.985500:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380200.985523:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc85760c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380200.985625:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867370368 00000100:00100000:3.0:1787380200.985629:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867370368 00000100:00100000:3.0:1787380200.985744:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787380200.985752:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:8427:x1874203867370368:12345-0@lo:503: 00000100:00100000:3.0:1787380200.985851:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:8427:x1874203867370368:12345-0@lo:503: Request processed in 100us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380200.985857:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787380200.985982:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867370368:0@lo:503: 00000040:00080000:1.0:1787380200.986172:0:8427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787380200.986222:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867370496:0@lo:502: 00000100:00100000:1.0:1787380200.986256:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380200.986313:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc85760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380200.986373:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867370496 00000100:00100000:2.0:1787380200.986377:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867370496 00000100:00100000:2.0:1787380200.986396:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787380200.986402:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:8427:x1874203867370496:12345-0@lo:502: 00000100:00100000:2.0:1787380200.986478:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:8427:x1874203867370496:12345-0@lo:502: Request processed in 75us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380200.986485:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787380200.986576:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867370496:0@lo:502: 00000040:00080000:1.0:1787380200.986732:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787380200.986758:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787380200.986773:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787380200.986787:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787380200.986851:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787380200.986867:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787380200.986880:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787380200.986891:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787380200.986903:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787380200.986916:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787380200.986929:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787380200.986943:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787380200.986955:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787380200.986968:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787380200.986981:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787380200.986995:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787380200.987010:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787380200.987023:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787380200.987053:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787380200.987068:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787380200.987079:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787380200.987091:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787380200.987104:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787380200.987119:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787380200.987132:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1787380200.987146:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1787380200.987159:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1787380200.987170:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1787380200.987184:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1787380200.987197:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1787380200.987211:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1787380200.987224:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1787380200.987249:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1787380200.987263:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1787380200.987288:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1787380200.987303:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1787380200.987315:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1787380200.987339:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867370624:0@lo:502: 00000100:00100000:1.0:1787380200.987379:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380200.987407:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc85760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380200.987553:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867370624 00000100:00100000:2.0:1787380200.987559:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867370624 00000100:00100000:2.0:1787380200.987583:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787380200.987595:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:8427:x1874203867370624:12345-0@lo:502: 00000100:00100000:2.0:1787380200.987682:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:8427:x1874203867370624:12345-0@lo:502: Request processed in 86us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380200.987689:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787380200.987838:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867370624:0@lo:502: 00000040:00080000:1.0:1787380200.987879:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1787380200.987888:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787380200.988444:0:8457:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787380200.988459:0:8457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9d6ffb90b380) 00000020:00000080:0.0:1787380200.988481:0:8457:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1787380200.988764:0:8457:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6ff5cad800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787380200.988768:0:8457:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6ff5cad800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787380200.988771:0:8457:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6ff5cad800 3 00010000:00080000:0.0:1787380200.988843:0:8457:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ec2381800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.130@tcp at head 00010000:00010000:1.0:1787380200.993661:0:8457:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1787380200.993756:0:8457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787380200.993832:0:8457:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787380200.993844:0:8457:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcf3c46fdcad68ab1 00000100:00080000:1.0:1787380200.993854:0:8457:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787380200.993860:0:8457:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d6ec2381800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:1.0:1787380200.993893:0:8457:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff3fc2680 x1874203867370752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787380200.993913:0:8457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787380200.993990:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1874203867370752:0@lo:38: 00000100:00100000:3.0:1787380200.994053:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380200.995878:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867370752 00000100:00100000:0.0:1787380200.995889:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867370752 00000100:00100000:0.0:1787380200.995928:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787380200.995936:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1874203867370752:12345-0@lo:38: 00010000:00080000:0.0:1787380200.995959:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:0.0:1787380200.995990:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcf3c46fdcad68ab8 00000004:00100000:0.0:1787380200.996004:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787380200.996033:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2381000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787380200.997679:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874203867370752:12345-0@lo:38: Request processed in 1732us (3614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380200.997709:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:0.0:1787380200.998109:0:8457:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787380200.998123:0:8457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9d6ffb908000) 00000020:00000080:0.0:1787380200.998145:0:8457:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1787380200.998305:0:8457:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6ff5cad800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787380200.998310:0:8457:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6ff5cad800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787380200.998312:0:8457:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6ff5cad800 3 00010000:00080000:0.0:1787380200.998341:0:8457:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ec2385800@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.130@tcp at head 00000100:00100000:1.0:1787380200.999949:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867370880:0@lo:400: 00000100:00100000:1.0:1787380201.000007:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380201.000036:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380201.000042:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867371264:0@lo:400: 00000100:00100000:1.0:1787380201.000066:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380201.000098:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867371008:0@lo:400: 00000100:00100000:1.0:1787380201.000119:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380201.000144:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787380201.000149:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867371136:0@lo:400: 00000100:00100000:1.0:1787380201.000169:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380201.000198:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867370880 00000100:00100000:1.0:1787380201.000204:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867370880 00000100:00100000:1.0:1787380201.000233:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867371136 00000100:00100000:1.0:1787380201.000236:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867371136 00000100:00100000:1.0:1787380201.000248:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787380201.000255:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867370880:12345-0@lo:400: 00000100:00100000:1.0:1787380201.000302:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867370880:12345-0@lo:400: Request processed in 47us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380201.000309:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787380201.000324:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787380201.000329:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867371136:12345-0@lo:400: 00000100:00100000:1.0:1787380201.000361:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867371136:12345-0@lo:400: Request processed in 31us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380201.000366:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787380201.000383:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867371264 00000100:00100000:1.0:1787380201.000386:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867371264 00000100:00100000:1.0:1787380201.000402:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867371008 00000100:00100000:1.0:1787380201.000404:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867371008 00000100:00100000:1.0:1787380201.000414:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787380201.000419:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867371264:12345-0@lo:400: 00000100:00100000:1.0:1787380201.000450:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867371264:12345-0@lo:400: Request processed in 30us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380201.000455:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787380201.000465:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787380201.000471:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867371008:12345-0@lo:400: 00000100:00100000:1.0:1787380201.000505:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867371008:12345-0@lo:400: Request processed in 34us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380201.000511:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787380201.000719:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867371264:0@lo:400: 00010000:00080000:1.0:1787380201.000736:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ff3fc0000 x1874203867370880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380201.000746:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867370880:0@lo:400: 00010000:00080000:1.0:1787380201.000774:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ff3fc2300 x1874203867371136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380201.000784:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867371136:0@lo:400: 00000100:00100000:1.0:1787380201.000804:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867371008:0@lo:400: 00010000:00080000:3.0:1787380201.001439:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ff3fc2680 x1874203867370752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787380210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380201.001448:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787380201.001462:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787380201.001469:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787380201.001475:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787380201.001479:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2381800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787380201.001485:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1874203867370752:0@lo:38: 00010000:00010000:0.0:1787380201.002643:0:8457:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1787380201.003715:0:8457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787380201.004082:0:8457:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787380201.004095:0:8457:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xcf3c46fdcad68ac6 00000100:00080000:0.0:1787380201.004105:0:8457:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787380201.004111:0:8457:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9d6ec2385800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1787380201.004141:0:8457:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff4e33480 x1874203867371392/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787380201.004193:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1874203867371392:0@lo:38: 00000100:00100000:3.0:1787380201.004254:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787380201.004318:0:8457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1787380201.004334:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867371392 00000100:00100000:2.0:1787380201.004342:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867371392 00000100:00100000:2.0:1787380201.004373:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787380201.004380:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1874203867371392:12345-0@lo:38: 00010000:00080000:2.0:1787380201.004402:0:6521:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:2.0:1787380201.004434:0:6521:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xcf3c46fdcad68acd 00000004:00100000:2.0:1787380201.004447:0:6521:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787380201.004475:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9d6fcff58800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787380201.004540:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874203867371392:12345-0@lo:38: Request processed in 159us (285us total) trans 0 rc 0/0 00010000:00080000:3.0:1787380201.004647:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ff4e33480 x1874203867371392/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787380211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380201.004657:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787380201.004663:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787380201.004669:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787380201.004674:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787380201.004676:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2385800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787380201.004682:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1874203867371392:0@lo:38: 00000100:00100000:2.0:1787380201.004726:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:0.0:1787380201.005008:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1787380201.005061:0:8427:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787380201.005088:0:8427:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787380201.005103:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68a9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68aa3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380201.005114:0:8427:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68aa3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787380201.005156:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787380201.005158:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787380201.005159:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380201.005160:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380201.005162:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380201.005163:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380201.005165:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787380201.005166:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787380201.005168:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787380201.005174:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380201.005175:0:8427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787380201.005179:0:8427:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1787380201.005181:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787380201.005182:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787380201.005183:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380201.005184:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380201.005185:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380201.005186:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380201.005187:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787380201.005188:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787380201.005189:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787380201.005190:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380201.005191:0:8427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787380201.005205:0:8427:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787380201.005216:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867371520:0@lo:253: 00000100:00100000:1.0:1787380201.005266:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380201.005295:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e8aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380201.005575:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867371520 00000100:00100000:2.0:1787380201.005581:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867371520 00000100:00100000:2.0:1787380201.005623:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787380201.005631:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:8427:x1874203867371520:12345-0@lo:253: 20000000:01000000:2.0:1787380201.005651:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787380201.005663:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787380201.011443:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787380201.011491:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787380201.011540:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787380201.011545:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787380201.011566:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68ad4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380201.011584:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc165bc00/0xcf3c46fdcad689ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad689c3 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380201.011592:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad689e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad689df expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380201.011600:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68ad4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380201.011635:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad689e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad689df expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380201.011661:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad689e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad689df expref: 16 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380201.011676:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874203867371648:0@lo:104: 00000100:00100000:1.0:1787380201.011740:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787380201.011789:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc165bc00/0xcf3c46fdcad689ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad689c3 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380201.012119:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:8427:x1874203867371520:12345-0@lo:253: Request processed in 6487us (6851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380201.012134:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787380201.012357:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:8427:1874203867371520:0@lo:253: 10000000:01000000:3.0:1787380201.012368:0:8427:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787380201.012371:0:8427:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787380201.012373:0:8427:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787380201.012374:0:8427:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787380201.012375:0:8427:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787380201.012376:0:8427:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787380201.012378:0:8427:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787380201.012379:0:8427:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787380201.012381:0:8427:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787380201.012382:0:8427:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787380201.012383:0:8427:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787380201.012384:0:8427:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787380201.012396:0:8427:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787380201.012678:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc165bc00/0xcf3c46fdcad689ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad689c3 expref: 15 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380201.012688:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874203867371776:0@lo:104: 00000100:00100000:1.0:1787380201.012714:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec249f840 going to sleep for 11 seconds 00000100:00100000:0.0:1787380201.012845:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787380201.012864:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380201.012885:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867371648 00000100:00100000:0.0:1787380201.012891:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867371648 00000100:00100000:0.0:1787380201.012932:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867371776 00000100:00100000:0.0:1787380201.012936:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867371776 00000100:00100000:0.0:1787380201.012951:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787380201.012958:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff58a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:6537:x1874203867371648:12345-0@lo:104: 00010000:00010000:0.0:1787380201.012970:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d400/0xcf3c46fdcad689df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad689e6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380201.013030:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787380201.013036:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff58a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:6537:x1874203867371648:12345-0@lo:104: Request processed in 79us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380201.013043:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787380201.013075:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787380201.013081:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:6537:x1874203867371776:12345-0@lo:104: 00010000:00010000:0.0:1787380201.013088:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ce00/0xcf3c46fdcad689c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad689ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380201.013119:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787380201.013124:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:6537:x1874203867371776:12345-0@lo:104: Request processed in 44us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380201.013130:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1787380201.013147:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787380201.013152:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d400/0xcf3c46fdcad689df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad689e6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380201.013160:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d400 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:0.0:1787380201.013163:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d400/0xcf3c46fdcad689df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad689e6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380201.013172:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d400/0xcf3c46fdcad689df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad689e6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380201.013178:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d400/0xcf3c46fdcad689df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad689e6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380201.013184:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787380201.013218:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d400/0xcf3c46fdcad689df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad689e6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380201.013224:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380201.013241:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d400/0xcf3c46fdcad689df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad689e6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380201.013248:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d400/0xcf3c46fdcad689df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad689e6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380201.013257:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380201.013261:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ce00/0xcf3c46fdcad689c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad689ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380201.013266:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89ce00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:0.0:1787380201.013269:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ce00/0xcf3c46fdcad689c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad689ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380201.013275:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ce00/0xcf3c46fdcad689c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad689ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380201.013282:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ce00/0xcf3c46fdcad689c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad689ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380201.013286:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787380201.013298:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ce00/0xcf3c46fdcad689c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad689ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380201.013303:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380201.013312:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ce00/0xcf3c46fdcad689c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad689ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380201.013328:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ce00/0xcf3c46fdcad689c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad689ca expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380201.013341:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380201.013342:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380201.013344:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380201.013356:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867371904:0@lo:103: 00000100:00100000:0.0:1787380201.013383:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380201.013464:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380201.013475:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867371904 00000100:00100000:2.0:1787380201.013485:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867371904 00010000:00010000:2.0:1787380201.013502:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad689e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad689df expref: 16 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380201.013530:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787380201.013537:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:3640:x1874203867371904:12345-0@lo:103: 00010000:00010000:2.0:1787380201.013546:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380201.013551:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad689e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad689df expref: 16 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380201.013561:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad689e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad689df expref: 16 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380201.013576:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380201.013607:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:3640:x1874203867371904:12345-0@lo:103: Request processed in 71us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380201.013613:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787380201.013640:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867371904:0@lo:103: 00000100:00100000:1.0:1787380201.013957:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867372032:0@lo:103: 00000100:00100000:1.0:1787380201.013986:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787380201.014065:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad689e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad689df expref: 15 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380201.014075:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874203867371648:0@lo:104: 00000100:00100000:1.0:1787380201.014086:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874203867371776:0@lo:104: 00010000:00010000:1.0:1787380201.014099:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68ad4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380201.014263:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867372032 00000100:00100000:2.0:1787380201.014268:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867372032 00010000:00010000:2.0:1787380201.014284:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc165bc00/0xcf3c46fdcad689ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad689c3 expref: 15 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380201.014343:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787380201.014351:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:3641:x1874203867372032:12345-0@lo:103: 00010000:00010000:2.0:1787380201.014360:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380201.014364:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc165bc00/0xcf3c46fdcad689ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad689c3 expref: 15 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380201.014386:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc165bc00/0xcf3c46fdcad689ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad689c3 expref: 15 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380201.014398:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc165bc00/0xcf3c46fdcad689ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad689c3 expref: 15 pid: 6516 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380201.014409:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68ad4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380201.014417:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68ad4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787380201.014429:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005298673s 00010000:00010000:2.0:1787380201.014433:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68ad4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380201.014439:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68ad4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380201.014445:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68ad4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380201.014451:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68ad4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380201.014456:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165be00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380201.014460:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68ad4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380201.014468:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68ad4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380201.014490:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68ad4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380201.014499:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380201.014531:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:3641:x1874203867372032:12345-0@lo:103: Request processed in 181us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380201.014538:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787380201.014565:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867372032:0@lo:103: 00010000:00010000:2.0:1787380201.014581:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68ad4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380201.014588:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68ad4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380201.014594:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68ad4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:2.0:1787380201.020331:0:8427:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1787380201.020499:0:8427:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1787380201.020687:0:8427:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1787380201.022009:0:8427:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1787380201.022270:0:8427:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1787380201.022472:0:8427:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1787380201.023668:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787380201.030393:0:8427:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787380201.030401:0:8427:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787380201.030436:0:8427:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787380201.030476:0:8427:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787380201.030509:0:8427:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787380201.030525:0:8427:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787380201.031298:0:8427:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787380201.031454:0:8427:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1787380201.549934:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787380201.877281:0:8513:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787380201.877661:0:8513:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787380202.574847:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380203.148776:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787380203.148833:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867372160:0@lo:41: 00000100:00100000:2.0:1787380203.148909:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380203.149116:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867372160 00000100:00100000:1.0:1787380203.149124:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867372160 00000100:00100000:1.0:1787380203.149167:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787380203.149176:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867372160:12345-0@lo:41: 00000004:00000024:1.0:1787380203.149216:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1787380203.149270:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867372160:12345-0@lo:41: Request processed in 95us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380203.149277:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787380203.149541:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867372160:0@lo:41: 00010000:00010000:2.0:1787380203.596540:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380204.620346:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380204.686145:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380204.686179:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867372288:0@lo:41: 00000100:00100000:2.0:1787380204.686239:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380204.687680:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867372288 00000100:00100000:0.0:1787380204.687691:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867372288 00000100:00100000:0.0:1787380204.687792:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787380204.687801:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867372288:12345-0@lo:41: 00000004:00000024:0.0:1787380204.687848:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1787380204.687912:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867372288:12345-0@lo:41: Request processed in 112us (1672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380204.687919:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787380204.688369:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867372288:0@lo:41: 00010000:00010000:2.0:1787380205.644305:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380206.220152:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867372672:0@lo:400: 00000100:00100000:0.0:1787380206.220220:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380206.220283:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867373184:0@lo:400: 00000100:00100000:0.0:1787380206.220318:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380206.220344:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787380206.220350:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867372544:0@lo:400: 00000100:00100000:0.0:1787380206.220388:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380206.220404:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1874203867373056:0@lo:400: 00000100:00100000:0.0:1787380206.220426:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380206.220458:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867372672 00000100:00100000:0.0:1787380206.220464:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867372672 00000100:00100000:0.0:1787380206.220501:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787380206.220508:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867372672:12345-0@lo:400: 00000100:00100000:0.0:1787380206.220554:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867372672:12345-0@lo:400: Request processed in 46us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380206.220560:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787380206.220581:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867373184 00000100:00100000:0.0:1787380206.220584:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867373184 00000100:00100000:0.0:1787380206.220607:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867372544 00000100:00100000:0.0:1787380206.220609:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867372544 00000100:00100000:0.0:1787380206.220619:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867373056 00000100:00100000:0.0:1787380206.220621:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867373056 00000100:00100000:0.0:1787380206.220634:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787380206.220639:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867373184:12345-0@lo:400: 00000100:00100000:0.0:1787380206.220666:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867373184:12345-0@lo:400: Request processed in 27us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380206.220671:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787380206.220682:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787380206.220687:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867372544:12345-0@lo:400: 00000100:00100000:0.0:1787380206.220708:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867372544:12345-0@lo:400: Request processed in 21us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380206.220712:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787380206.220721:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787380206.220725:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874203867373056:12345-0@lo:400: 00000100:00100000:0.0:1787380206.220756:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874203867373056:12345-0@lo:400: Request processed in 31us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380206.220762:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787380206.220793:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787380206.220797:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1787380206.220837:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff4e31f80 x1874203867372544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380206.220849:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867372544:0@lo:400: 00010000:00080000:0.0:1787380206.220859:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc478d500 x1874203867373056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380206.220867:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1874203867373056:0@lo:400: 00000100:00100000:0.0:1787380206.220875:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867372672:0@lo:400: 00010000:00080000:0.0:1787380206.220883:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc478e300 x1874203867373184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380206.220891:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867373184:0@lo:400: 00000100:00100000:1.0:1787380206.221544:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867372800:0@lo:400: 00000100:00100000:1.0:1787380206.221582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380206.221603:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787380206.221610:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867372416:0@lo:400: 00000100:00100000:1.0:1787380206.221634:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380206.221660:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867372928:0@lo:400: 00000100:00100000:1.0:1787380206.221683:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380206.221705:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867372416 00000100:00100000:1.0:1787380206.221709:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867372416 00000100:00100000:1.0:1787380206.221735:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787380206.221741:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:3639:x1874203867372416:12345-0@lo:400: 00000100:00100000:1.0:1787380206.221787:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:3639:x1874203867372416:12345-0@lo:400: Request processed in 46us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380206.221793:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787380206.221843:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867372416:0@lo:400: 00000100:00100000:0.0:1787380206.222536:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867372928 00000100:00100000:0.0:1787380206.222542:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867372928 00000100:00100000:0.0:1787380206.222581:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787380206.222588:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867372928:12345-0@lo:400: 00000100:00100000:0.0:1787380206.222637:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867372928:12345-0@lo:400: Request processed in 49us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380206.222643:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787380206.222690:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867372928:0@lo:400: 00000100:00100000:0.0:1787380206.222709:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867372800 00000100:00100000:0.0:1787380206.222724:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867372800 00000100:00100000:0.0:1787380206.222745:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787380206.222751:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867372800:12345-0@lo:400: 00000100:00100000:0.0:1787380206.222796:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867372800:12345-0@lo:400: Request processed in 45us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380206.222803:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787380206.222845:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff4e33480 x1874203867372800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380206.222855:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867372800:0@lo:400: 00010000:00010000:0.0:1787380206.669250:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787380207.335107:0:8803:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787380207.692029:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787380208.269438:0:8855:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787380208.269729:0:8855:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787380208.269966:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 10000000:01000000:1.0:1787380208.270387:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787380208.270391:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6ff3dad800 from 30 10000000:01000000:1.0:1787380208.270395:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787380208.270424:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68adb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380208.270436:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68adb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380208.270459:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68adb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380208.270479:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867373440:0@lo:101: 00000100:00100000:1.0:1787380208.270549:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380208.270586:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4ec0600 going to sleep for 11 seconds 00000100:00100000:2.0:1787380208.270849:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867373440 00000100:00100000:2.0:1787380208.270856:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867373440 00000100:00100000:2.0:1787380208.270899:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787380208.270908:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:6518:x1874203867373440:12345-0@lo:101: 00010000:00010000:2.0:1787380208.270920:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380208.270930:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68ae2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68adb expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380208.270950:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68adb expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380208.270970:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68adb expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380208.270978:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89d800, rc 0) 00000100:00100000:2.0:1787380208.271132:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:6518:x1874203867373440:12345-0@lo:101: Request processed in 225us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380208.271139:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787380208.271194:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867373440:0@lo:101: 00010000:00010000:2.0:1787380208.271207:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68adb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68ae2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380208.271216:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68adb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68ae2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380208.271269:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867373568:0@lo:501: 00000100:00100000:2.0:1787380208.271294:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380208.271316:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380208.271422:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867373568 00000100:00100000:0.0:1787380208.271426:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867373568 00000100:00100000:0.0:1787380208.271455:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787380208.271461:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:6518:x1874203867373568:12345-0@lo:501: 00000100:00100000:0.0:1787380208.271579:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:6518:x1874203867373568:12345-0@lo:501: Request processed in 117us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380208.271585:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787380208.272628:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867373568:0@lo:501: 00000100:00100000:2.0:1787380208.272672:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867373696:0@lo:503: 00000100:00100000:2.0:1787380208.272721:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380208.272766:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380208.273102:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867373696 00000100:00100000:0.0:1787380208.273108:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867373696 00000100:00100000:2.0:1787380208.273219:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787380208.273229:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:6518:x1874203867373696:12345-0@lo:503: 00000100:00100000:2.0:1787380208.273323:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:6518:x1874203867373696:12345-0@lo:503: Request processed in 95us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380208.273337:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787380208.273374:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867373696:0@lo:503: 00000100:00100000:2.0:1787380208.273646:0:8857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8857:1874203867373824:0@lo:502: 00000100:00100000:2.0:1787380208.273678:0:8857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380208.273996:0:8857:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787380208.274232:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867373312:0@lo:41: 00000100:00100000:2.0:1787380208.274262:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380208.274324:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867373312 00000100:00100000:1.0:1787380208.274329:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867373312 00000100:00100000:1.0:1787380208.274362:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787380208.274369:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867373312:12345-0@lo:41: 00000004:00000024:1.0:1787380208.274393:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1787380208.274437:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867373312:12345-0@lo:41: Request processed in 68us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380208.274443:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787380208.274502:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867373312:0@lo:41: 00000100:00100000:0.0:1787380208.274630:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867373824 00000100:00100000:0.0:1787380208.274635:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867373824 00000100:00100000:0.0:1787380208.274691:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787380208.274698:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:8857:x1874203867373824:12345-0@lo:502: 00000100:00100000:0.0:1787380208.274802:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:8857:x1874203867373824:12345-0@lo:502: Request processed in 105us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380208.274828:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787380208.274901:0:8857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8857:1874203867373824:0@lo:502: 00000100:00100000:3.0:1787380208.274942:0:8857:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8857:1874203867373952:0@lo:502: 00000100:00100000:3.0:1787380208.274970:0:8857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380208.277933:0:8857:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041a000 going to sleep for 11 seconds 00000100:00100000:2.0:1787380208.278863:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867373952 00000100:00100000:2.0:1787380208.278873:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867373952 00000100:00100000:2.0:1787380208.278923:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787380208.278933:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:8857:x1874203867373952:12345-0@lo:502: 00000100:00100000:2.0:1787380208.279098:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:8857:x1874203867373952:12345-0@lo:502: Request processed in 166us (4126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380208.279106:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787380208.279298:0:8857:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8857:1874203867373952:0@lo:502: 00000040:00080000:3.0:1787380208.279329:0:8857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787380208.280130:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787380208.280163:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787380208.280173:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68adb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68ae2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380208.280184:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68ae2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380208.280194:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787380208.280197:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6ff3dad800 from 5 10000000:01000000:2.0:1787380208.280199:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787380208.280228:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad68ae9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380208.280248:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad68ae9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380208.280258:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad68ae9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380208.280275:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867374080:0@lo:101: 00000100:00100000:2.0:1787380208.280319:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380208.280379:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867374080 00000100:00100000:0.0:1787380208.280384:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867374080 00000100:00100000:0.0:1787380208.280416:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787380208.280423:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:6518:x1874203867374080:12345-0@lo:101: 00010000:00010000:0.0:1787380208.280433:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380208.280444:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc0030400/0xcf3c46fdcad68af0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68ae9 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380208.280464:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc0030400/0xcf3c46fdcad68af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68ae9 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380208.280473:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc0030400/0xcf3c46fdcad68af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68ae9 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380208.280481:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc0030400, rc 0) 00000100:00100000:0.0:1787380208.280523:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867374080:12345-0@lo:101: Request processed in 100us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380208.280529:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787380208.283313:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787380208.283355:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867374080:0@lo:101: 00010000:00010000:2.0:1787380208.283377:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad68ae9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68af0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380208.283389:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad68ae9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68af0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380208.283455:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867374208:0@lo:256: 00000100:00100000:2.0:1787380208.283522:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380208.283552:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787380208.283572:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867374208 00000100:00100000:2.0:1787380208.283578:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867374208 00000100:00100000:2.0:1787380208.283618:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787380208.283626:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867374208:12345-0@lo:256: 20000000:01000000:2.0:1787380208.283645:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787380208.283662:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787380208.283665:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787380208.283745:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867374208:12345-0@lo:256: Request processed in 118us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380208.283768:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787380208.283828:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867374208:0@lo:256: 10000000:01000000:2.0:1787380208.283868:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787380208.283875:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad68ae9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68af0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380208.283884:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad68ae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68af0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380208.283893:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787380208.283895:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1787380208.283898:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787380208.283919:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380208.283926:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380208.283934:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380208.283945:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867374336:0@lo:101: 00000100:00100000:2.0:1787380208.283967:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380208.283982:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787380208.283992:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867374336 00000100:00100000:2.0:1787380208.283996:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867374336 00000100:00100000:2.0:1787380208.284023:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787380208.284029:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867374336:12345-0@lo:101: 00010000:00010000:2.0:1787380208.284044:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380208.284054:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89d600/0xcf3c46fdcad68afe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68af7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380208.284070:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89d600/0xcf3c46fdcad68afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68af7 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380208.284077:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89d600/0xcf3c46fdcad68afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68af7 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380208.284085:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89d600, rc 0) 00000100:00100000:2.0:1787380208.284109:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867374336:12345-0@lo:101: Request processed in 80us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380208.284115:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787380208.284141:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867374336:0@lo:101: 00010000:00010000:2.0:1787380208.284357:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68afe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380208.284365:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68afe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380208.284411:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867374464:0@lo:501: 00000100:00100000:2.0:1787380208.284434:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380208.284493:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787380208.286451:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867374464 00000100:00100000:1.0:1787380208.286464:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867374464 00000100:00100000:1.0:1787380208.287386:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787380208.287398:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867374464:12345-0@lo:501: 00000100:00100000:1.0:1787380208.287559:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867374464:12345-0@lo:501: Request processed in 163us (3122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380208.287566:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787380208.287615:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867374464:0@lo:501: 00000100:00100000:1.0:1787380208.287654:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867374592:0@lo:503: 00000100:00100000:1.0:1787380208.287696:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380208.287720:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fb9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787380208.287734:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867374592 00000100:00100000:1.0:1787380208.287738:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867374592 00000100:00100000:1.0:1787380208.287766:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787380208.287772:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867374592:12345-0@lo:503: 00000100:00100000:1.0:1787380208.287846:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867374592:12345-0@lo:503: Request processed in 74us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380208.287853:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787380208.287888:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867374592:0@lo:503: 00000100:00100000:1.0:1787380208.288209:0:8858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8858:1874203867374720:0@lo:502: 00000100:00100000:1.0:1787380208.288242:0:8858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380208.288260:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867374720 00000100:00100000:1.0:1787380208.288264:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867374720 00000100:00100000:1.0:1787380208.288281:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787380208.288286:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:8858:x1874203867374720:12345-0@lo:502: 00000100:00100000:1.0:1787380208.288351:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:8858:x1874203867374720:12345-0@lo:502: Request processed in 64us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380208.288357:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787380208.288388:0:8858:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fb9600 going to sleep for 11 seconds 00000100:00100000:1.0:1787380208.288401:0:8858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8858:1874203867374720:0@lo:502: 00000020:01000000:1.0:1787380208.288420:0:8858:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787380208.288428:0:8858:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787380208.288434:0:8858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380208.288436:0:8858:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787380208.288441:0:8858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787380208.288445:0:8858:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.130@tcp to nid 0x20000c0a8ce82 (192.168.206.130@tcp) 00000020:01000000:1.0:1787380208.288465:0:8858:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787380208.288468:0:8858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787380208.288488:0:8858:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9d6ffc738000) 00000020:00000080:1.0:1787380208.289708:0:8858:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1787380208.289723:0:8858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787380208.289868:0:8858:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1787380208.289875:0:8858:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787380208.289884:0:8858:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf3c46fdcad68b0c 00010000:00080000:1.0:1787380208.289924:0:8858:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ec20bc800@lustre-OST0000-osc-MDT0001: add connection 192.168.206.130@tcp at head 00010000:00010000:1.0:1787380208.290915:0:8858:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1787380208.298949:0:8858:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787380208.298972:0:8858:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787380208.299170:0:8858:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380208.299383:0:8858:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380208.299475:0:8858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787380208.299578:0:8858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787380208.300158:0:8860:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787380208.300163:0:8860:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787380208.300686:0:8858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787380208.300695:0:8858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787380208.300730:0:8858:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787380208.300750:0:8858:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3c46fdcad68b13 00000100:00080000:0.0:1787380208.300769:0:8858:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787380208.300775:0:8858:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9d6ec20bc800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1787380208.300831:0:8858:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6fc478d500 x1874203867374848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787380208.300850:0:8858:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787380208.300908:0:8858:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380208.300912:0:8858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380208.300914:0:8858:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787380208.300916:0:8858:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380208.300920:0:8858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380208.300921:0:8858:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787380208.300924:0:8858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787380208.300925:0:8858:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787380208.300949:0:8858:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8858:1874203867374976:0@lo:502: 00000100:00100000:0.0:1787380208.301028:0:8858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380208.301058:0:8858:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb85cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380208.301255:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867374848:0@lo:8: 00000100:00100000:3.0:1787380208.301287:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380208.301352:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867374848 00000100:00100000:0.0:1787380208.301359:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867374848 00000100:00100000:0.0:1787380208.301417:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787380208.301424:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1874203867374848:12345-0@lo:8: 00010000:00080000:0.0:1787380208.301446:0:8433:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:0.0:1787380208.301467:0:8433:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3c46fdcad68b1a 00002000:00100000:0.0:1787380208.301493:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9d6ec2385000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113674 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787380208.301497:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1787380208.301509:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787380208.301552:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787380208.301727:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1787380208.301748:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2382000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787380208.301802:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1874203867374848:12345-0@lo:8: Request processed in 377us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380208.301824:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380208.301945:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867374976 00000100:00100000:1.0:1787380208.301950:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867374976 00000100:00100000:1.0:1787380208.301975:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787380208.301981:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:8858:x1874203867374976:12345-0@lo:502: 00000100:00100000:1.0:1787380208.302083:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:8858:x1874203867374976:12345-0@lo:502: Request processed in 101us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380208.302090:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787380208.302124:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867375104:0@lo:400: 00000100:00100000:1.0:1787380208.302160:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380208.302177:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867375616:0@lo:400: 00000100:00100000:1.0:1787380208.302194:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380208.302208:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380208.302213:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1874203867375488:0@lo:400: 00000100:00100000:1.0:1787380208.302233:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380208.302256:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867375232:0@lo:400: 00000100:00100000:1.0:1787380208.302285:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380208.302297:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787380208.302301:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867375360:0@lo:400: 00000100:00100000:1.0:1787380208.302321:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380208.302345:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867375104 00000100:00100000:1.0:1787380208.302348:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867375104 00000100:00100000:1.0:1787380208.302365:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867375616 00000100:00100000:1.0:1787380208.302367:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867375616 00000100:00100000:1.0:1787380208.302384:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867375488 00000100:00100000:1.0:1787380208.302386:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867375488 00000100:00100000:1.0:1787380208.302395:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867375232 00000100:00100000:1.0:1787380208.302397:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867375232 00000100:00100000:1.0:1787380208.302406:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787380208.302412:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867375104:12345-0@lo:400: 00000100:00100000:1.0:1787380208.302445:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867375104:12345-0@lo:400: Request processed in 34us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380208.302451:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787380208.302462:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787380208.302467:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867375616:12345-0@lo:400: 00000100:00100000:1.0:1787380208.302491:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867375616:12345-0@lo:400: Request processed in 25us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380208.302497:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787380208.302506:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787380208.302511:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874203867375488:12345-0@lo:400: 00000100:00100000:1.0:1787380208.302532:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874203867375488:12345-0@lo:400: Request processed in 21us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380208.302538:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787380208.302547:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787380208.302557:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867375232:12345-0@lo:400: 00000100:00100000:1.0:1787380208.302584:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867375232:12345-0@lo:400: Request processed in 28us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380208.302590:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787380208.302610:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867375360 00000100:00100000:1.0:1787380208.302614:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867375360 00000100:00100000:1.0:1787380208.302634:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787380208.302640:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867375360:12345-0@lo:400: 00000100:00100000:1.0:1787380208.302665:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867375360:12345-0@lo:400: Request processed in 26us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380208.302671:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787380208.302685:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787380208.302688:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787380208.302712:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867375360:0@lo:400: 00010000:00080000:1.0:1787380208.302722:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3fc1c00 x1874203867375232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380208.302731:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867375232:0@lo:400: 00010000:00080000:1.0:1787380208.302765:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3fc2680 x1874203867375488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380208.302773:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1874203867375488:0@lo:400: 00010000:00080000:1.0:1787380208.302784:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3fc3800 x1874203867375104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380208.302791:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867375104:0@lo:400: 00010000:00080000:1.0:1787380208.302800:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3fc2a00 x1874203867375616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380208.302842:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867375616:0@lo:400: 00000100:00100000:1.0:1787380208.306131:0:8858:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8858:1874203867374976:0@lo:502: 00000020:01000000:1.0:1787380208.306178:0:8858:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380208.306188:0:8858:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380208.306190:0:8858:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787380208.306195:0:8858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1787380208.306260:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1787380208.306278:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787380208.306289:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68afe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380208.306300:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68afe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380208.306309:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787380208.306311:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6fc873b000 from 30 10000000:01000000:1.0:1787380208.306314:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787380208.306346:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380208.306353:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380208.306362:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380208.306380:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867375744:0@lo:101: 00000100:00100000:1.0:1787380208.306434:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380208.306482:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fb9600 going to sleep for 11 seconds 00010000:00080000:3.0:1787380208.310440:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc478d500 x1874203867374848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787380218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380208.310996:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867375744 00000100:00100000:0.0:1787380208.311005:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867375744 00000100:00100000:3.0:1787380208.312229:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787380208.312240:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787380208.312249:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787380208.312255:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787380208.312258:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec20bc800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787380208.312271:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787380208.312276:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867374848:0@lo:8: 00000100:00100000:0.0:1787380208.312357:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787380208.312374:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867375744:12345-0@lo:101: 00010000:00010000:0.0:1787380208.312387:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380208.312402:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc0031400/0xcf3c46fdcad68b28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68b21 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380208.312426:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc0031400/0xcf3c46fdcad68b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68b21 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380208.312437:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc0031400/0xcf3c46fdcad68b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68b21 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380208.312445:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc0031400, rc 0) 00000100:00100000:0.0:1787380208.312594:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867375744:12345-0@lo:101: Request processed in 222us (6159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380208.315089:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867375744:0@lo:101: 00010000:00010000:3.0:1787380208.315114:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68b21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68b28 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.315126:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68b21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68b28 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380208.315238:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ffaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867375872:0@lo:501: 00000100:00100000:3.0:1787380208.315295:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380208.315335:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787380208.315368:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867375872 00000100:00100000:3.0:1787380208.315374:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867375872 00000100:00100000:0.0:1787380208.321561:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787380208.321563:0:8861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8861:1874203867376000:0@lo:700: 00000100:00100000:2.0:1787380208.321626:0:8861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380208.321652:0:8861:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380208.321676:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867376000 00000100:00100000:0.0:1787380208.321683:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867376000 00000100:00100000:0.0:1787380208.321745:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787380208.321767:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8861:x1874203867376000:12345-0@lo:700: 00000100:00100000:0.0:1787380208.321802:0:8442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8442:1874203867376128:0@lo:700: 00000100:00100000:0.0:1787380208.321908:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380208.321927:0:8442:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb85cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787380208.321941:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867376128 00000100:00100000:0.0:1787380208.321945:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867376128 00000100:00100000:0.0:1787380208.321972:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787380208.321978:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8442:x1874203867376128:12345-0@lo:700: 00000004:00080000:0.0:1787380208.322346:0:8860:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787380208.322396:0:8860:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 218646586035ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787380208.322407:0:8860:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:2.0:1787380208.323920:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380208.327433:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787380208.327458:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867375872:12345-0@lo:501: 00000100:00100000:3.0:1787380208.327618:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867375872:12345-0@lo:501: Request processed in 173us (12322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380208.327626:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787380208.330099:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ffaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867375872:0@lo:501: 00000100:00100000:0.0:1787380208.330164:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867376256:0@lo:503: 00000100:00100000:0.0:1787380208.330242:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787380208.330864:0:7453:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1787380208.330903:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867376256 00000100:00100000:2.0:1787380208.330910:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867376256 00000100:00100000:2.0:1787380208.330953:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787380208.330963:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867376256:12345-0@lo:503: 00000100:00100000:2.0:1787380208.331200:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867376256:12345-0@lo:503: Request processed in 238us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380208.331208:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787380208.337156:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb85c180 going to sleep for 11 seconds 00000100:00100000:0.0:1787380208.337199:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867376256:0@lo:503: 40000000:02000000:1.0:1787380208.338894:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1787380208.338982:0:8864:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8864:1874203867376384:0@lo:502: 00000100:00100000:0.0:1787380208.339053:0:8864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380208.339082:0:8864:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb85c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787380208.339114:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867376384 00000100:00100000:3.0:1787380208.339121:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867376384 00000100:00100000:3.0:1787380208.339250:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787380208.339260:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:8864:x1874203867376384:12345-0@lo:502: 00000100:00100000:3.0:1787380208.339372:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:8864:x1874203867376384:12345-0@lo:502: Request processed in 113us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380208.339380:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787380208.339430:0:8864:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8864:1874203867376384:0@lo:502: 00000100:00100000:3.0:1787380208.339474:0:8864:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8864:1874203867376512:0@lo:502: 00000100:00100000:3.0:1787380208.339509:0:8864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380208.339524:0:8864:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041a900 going to sleep for 11 seconds 00000100:00100000:0.0:1787380208.339586:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867376512 00000100:00100000:0.0:1787380208.339590:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867376512 00000100:00100000:0.0:1787380208.339620:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787380208.339627:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:8864:x1874203867376512:12345-0@lo:502: 00000100:00100000:0.0:1787380208.339692:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:8864:x1874203867376512:12345-0@lo:502: Request processed in 65us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380208.339699:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787380208.340248:0:8864:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8864:1874203867376512:0@lo:502: 00000040:00080000:3.0:1787380208.340271:0:8864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787380208.354152:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787380208.354195:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787380208.354207:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68b21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68b28 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380208.354220:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68b28 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380208.354230:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787380208.354233:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6fc873b000 from 5 10000000:01000000:0.0:1787380208.354236:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787380208.354282:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380208.354290:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380208.354300:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380208.354320:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867376640:0@lo:101: 00000100:00100000:0.0:1787380208.354377:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380208.354418:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec249fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380208.354562:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867376640 00000100:00100000:3.0:1787380208.354576:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867376640 00000100:00100000:3.0:1787380208.354623:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787380208.354631:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867376640:12345-0@lo:101: 00010000:00010000:3.0:1787380208.354644:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380208.354655:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad68b36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68b2f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.354679:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad68b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68b2f expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.354688:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad68b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68b2f expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.354697:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9a000, rc 0) 00000100:00100000:3.0:1787380208.354737:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:6518:x1874203867376640:12345-0@lo:101: Request processed in 107us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380208.354744:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787380208.354795:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867376640:0@lo:101: 00010000:00010000:3.0:1787380208.354826:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68b2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.354834:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68b2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380208.354878:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867376768:0@lo:256: 00000100:00100000:3.0:1787380208.354905:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380208.354917:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787380208.354927:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867376768 00000100:00100000:3.0:1787380208.354930:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867376768 00000100:00100000:3.0:1787380208.354955:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787380208.354960:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:6518:x1874203867376768:12345-0@lo:256: 20000000:01000000:3.0:1787380208.354972:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787380208.354986:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787380208.354988:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787380208.355064:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:6518:x1874203867376768:12345-0@lo:256: Request processed in 103us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380208.355071:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787380208.355093:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867376768:0@lo:256: 10000000:01000000:3.0:1787380208.355129:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787380208.355134:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68b2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.355151:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380208.355158:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787380208.355160:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1787380208.355162:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787380208.355176:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9a600/0xcf3c46fdcad68b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.355183:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9a600/0xcf3c46fdcad68b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.355190:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9a600/0xcf3c46fdcad68b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380208.355201:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867376896:0@lo:101: 00000100:00100000:3.0:1787380208.355232:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380208.355246:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787380208.355256:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867376896 00000100:00100000:3.0:1787380208.355259:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867376896 00000100:00100000:3.0:1787380208.355275:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787380208.355280:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:6518:x1874203867376896:12345-0@lo:101: 00010000:00010000:3.0:1787380208.355286:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380208.355294:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68b44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68b3d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.355307:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68b3d expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.355314:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68b3d expref: 20 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.355320:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9ac00, rc 0) 00000100:00100000:3.0:1787380208.355346:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867376896:12345-0@lo:101: Request processed in 65us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380208.355352:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787380208.355377:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867376896:0@lo:101: 00010000:00010000:3.0:1787380208.355386:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9a600/0xcf3c46fdcad68b3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.355394:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9a600/0xcf3c46fdcad68b3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380208.355437:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867377024:0@lo:501: 00000100:00100000:3.0:1787380208.355467:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380208.355479:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787380208.355490:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867377024 00000100:00100000:3.0:1787380208.355493:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867377024 00000100:00100000:3.0:1787380208.355508:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787380208.355514:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867377024:12345-0@lo:501: 00000100:00100000:3.0:1787380208.355608:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867377024:12345-0@lo:501: Request processed in 93us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380208.355614:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787380208.355650:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867377024:0@lo:501: 00000100:00100000:3.0:1787380208.355671:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867377152:0@lo:503: 00000100:00100000:3.0:1787380208.355706:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380208.355719:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787380208.355728:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867377152 00000100:00100000:3.0:1787380208.355731:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867377152 00000100:00100000:3.0:1787380208.355746:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787380208.355764:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867377152:12345-0@lo:503: 00000100:00100000:3.0:1787380208.355864:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867377152:12345-0@lo:503: Request processed in 111us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380208.355871:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787380208.355909:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867377152:0@lo:503: 00000100:00100000:0.0:1787380208.359788:0:8866:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8866:1874203867377280:0@lo:502: 00000100:00100000:0.0:1787380208.359898:0:8866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380208.359926:0:8866:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec249f000 going to sleep for 11 seconds 00000100:00100000:3.0:1787380208.359989:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867377280 00000100:00100000:3.0:1787380208.359996:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867377280 00000100:00100000:3.0:1787380208.360055:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787380208.360064:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:8866:x1874203867377280:12345-0@lo:502: 00000100:00100000:3.0:1787380208.360333:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:8866:x1874203867377280:12345-0@lo:502: Request processed in 269us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380208.360347:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787380208.360427:0:8866:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8866:1874203867377280:0@lo:502: 00000020:01000000:0.0:1787380208.360453:0:8866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787380208.360461:0:8866:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1787380208.360468:0:8866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380208.360470:0:8866:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787380208.360477:0:8866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787380208.360480:0:8866:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.130@tcp to nid 0x20000c0a8ce82 (192.168.206.130@tcp) 00000020:01000000:0.0:1787380208.360500:0:8866:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787380208.360503:0:8866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787380208.360537:0:8866:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9d6ff5f60000) 00000020:00000080:0.0:1787380208.360560:0:8866:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1787380208.360567:0:8866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787380208.360643:0:8866:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787380208.360648:0:8866:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787380208.360661:0:8866:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3c46fdcad68b52 00010000:00080000:0.0:1787380208.360686:0:8866:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ec20bd000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.130@tcp at head 00010000:00010000:0.0:1787380208.360952:0:8866:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:1.0:1787380208.362874:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8442:x1874203867376128:12345-0@lo:700: Request processed in 40888us (40958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380208.362886:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787380208.362934:0:8442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc478c700 x1874203867376128/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787380224 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380208.362948:0:8442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8442:1874203867376128:0@lo:700: 40000000:02000000:1.0:1787380208.362959:0:8442:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000001:00100000:0.0:1787380208.379410:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1787380208.379598:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8861:x1874203867376000:12345-0@lo:700: Request processed in 57842us (57967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380208.379615:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:0.0:1787380208.379707:0:8866:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787380208.379722:0:8866:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787380208.379920:0:8866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380208.381327:0:8866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380208.382136:0:8866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787380208.382307:0:8866:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00010000:00080000:2.0:1787380208.382554:0:8861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec20a6680 x1874203867376000/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787380224 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380208.382570:0:8861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8861:1874203867376000:0@lo:700: 00000040:00080000:3.0:1787380208.386740:0:8867:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787380208.386747:0:8867:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787380208.389723:0:8866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787380208.389738:0:8866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787380208.389805:0:8866:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787380208.389852:0:8866:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3c46fdcad68b59 00000100:00080000:3.0:1787380208.389861:0:8866:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787380208.389867:0:8866:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d6ec20bd000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1787380208.389899:0:8866:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff3ff8000 x1874203867377408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787380208.389929:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867377408:0@lo:8: 00000100:00100000:3.0:1787380208.389993:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380208.390084:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867377408 00000100:00100000:3.0:1787380208.390091:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867377408 00000100:00100000:3.0:1787380208.390122:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787380208.390129:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1874203867377408:12345-0@lo:8: 00010000:00080000:3.0:1787380208.390156:0:8436:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:3.0:1787380208.390179:0:8436:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3c46fdcad68b60 00002000:00100000:3.0:1787380208.390192:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9d6fff5a5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113674 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787380208.390196:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787380208.390199:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787380208.390276:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787380208.390298:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9d6fff5a1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787380208.390349:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1874203867377408:12345-0@lo:8: Request processed in 218us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380208.390366:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787380208.390413:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3ff8000 x1874203867377408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787380218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380208.390423:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787380208.390431:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787380208.390438:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787380208.390442:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787380208.390444:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec20bd000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787380208.390455:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787380208.390460:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867377408:0@lo:8: 00000004:00080000:3.0:1787380208.390481:0:8867:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787380208.390528:0:8867:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 218714717761ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787380208.390534:0:8867:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:3.0:1787380208.390561:0:8866:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787380208.390616:0:8866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380208.390620:0:8866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380208.390622:0:8866:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787380208.390625:0:8866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380208.390629:0:8866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380208.390630:0:8866:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787380208.390633:0:8866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787380208.390635:0:8866:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787380208.390658:0:8866:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8866:1874203867377536:0@lo:502: 00000100:00100000:3.0:1787380208.390696:0:8866:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380208.390719:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867377536 00000100:00100000:3.0:1787380208.390723:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867377536 00000100:00100000:3.0:1787380208.390749:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787380208.390769:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:8866:x1874203867377536:12345-0@lo:502: 00000100:00100000:3.0:1787380208.390886:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:8866:x1874203867377536:12345-0@lo:502: Request processed in 118us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380208.390893:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787380208.390958:0:8866:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb45d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380208.390971:0:8866:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:8866:1874203867377536:0@lo:502: 00000020:01000000:3.0:1787380208.390989:0:8866:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380208.390993:0:8866:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380208.390995:0:8866:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787380208.390998:0:8866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1787380208.391044:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1787380208.391062:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787380208.391071:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9a600/0xcf3c46fdcad68b3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.391082:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9a600/0xcf3c46fdcad68b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380208.391092:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787380208.391094:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9d6ff8828000 from 1 10000000:01000000:3.0:1787380208.391098:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787380208.391121:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.391130:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.391139:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68b67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380208.391150:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867377664:0@lo:101: 00000100:00100000:3.0:1787380208.391180:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380208.391194:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e8a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787380208.391206:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867377664 00000100:00100000:3.0:1787380208.391209:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867377664 00000100:00100000:3.0:1787380208.391232:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787380208.391238:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867377664:12345-0@lo:101: 00010000:00010000:3.0:1787380208.391246:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380208.391257:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9a400/0xcf3c46fdcad68b6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68b67 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.391277:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9a400/0xcf3c46fdcad68b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68b67 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.391287:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9a400/0xcf3c46fdcad68b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68b67 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.391295:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9a400, rc 0) 00000100:00100000:3.0:1787380208.391320:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867377664:12345-0@lo:101: Request processed in 82us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380208.391326:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787380208.391354:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867377664:0@lo:101: 00010000:00010000:3.0:1787380208.391365:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68b67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68b6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.391373:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68b67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68b6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380208.391413:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867377792:0@lo:501: 00000100:00100000:3.0:1787380208.391448:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380208.391461:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e8a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787380208.391471:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867377792 00000100:00100000:3.0:1787380208.391474:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867377792 00000100:00100000:3.0:1787380208.391495:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787380208.391501:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867377792:12345-0@lo:501: 00000100:00100000:3.0:1787380208.391558:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867377792:12345-0@lo:501: Request processed in 56us (109us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787380208.391564:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787380208.391593:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867377792:0@lo:501: 10000000:01000000:3.0:1787380208.391612:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787380208.391617:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68b67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68b6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380208.391624:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68b6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787380208.397660:0:8861:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787380208.397693:0:8861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8861:1874203867378048:0@lo:7: 00000100:00100000:3.0:1787380208.397762:0:8861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380208.397801:0:8861:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e8a840 going to sleep for 11 seconds 00000100:00100000:3.0:1787380208.397841:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867378048 00000100:00100000:3.0:1787380208.397848:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867378048 00000100:00100000:3.0:1787380208.397892:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380208.397900:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8861:x1874203867378048:12345-0@lo:7: 00000100:00100000:1.0:1787380208.398099:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787380208.398110:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867377920:0@lo:13: 00000100:00100000:1.0:1787380208.398260:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787380208.405064:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787380208.407141:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867377920 00000100:00100000:2.0:1787380208.407162:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867377920 00000100:00100000:2.0:1787380208.407213:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380208.407223:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1874203867377920:12345-0@lo:13: 00002000:00000024:2.0:1787380208.407248:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923812352 avail 3692290048 00000100:00100000:2.0:1787380208.407331:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3642:x1874203867377920:12345-0@lo:13: Request processed in 109us (9070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380208.407337:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787380208.407396:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3ff8000 x1874203867377920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380208.407415:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867377920:0@lo:13: 00002000:00080000:3.0:1787380208.407717:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787380208.407722:0:8433:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1787380208.407785:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8861:x1874203867378048:12345-0@lo:7: Request processed in 9885us (10032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380208.407793:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:3.0:1787380208.407895:0:8869:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787380208.407927:0:8869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8869:1874203867378304:0@lo:7: 00000100:00100000:3.0:1787380208.407958:0:8869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380208.407982:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867378304 00000100:00100000:3.0:1787380208.407987:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867378304 00000100:00100000:3.0:1787380208.408027:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380208.408035:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8869:x1874203867378304:12345-0@lo:7: 00000100:00100000:2.0:1787380208.408931:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867378176:0@lo:13: 00000100:00100000:2.0:1787380208.408972:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787380208.409025:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787380208.409067:0:8861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3ff9180 x1874203867378048/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787380224 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380208.409087:0:8861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8861:1874203867378048:0@lo:7: 00000004:00080000:2.0:1787380208.409098:0:8861:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787380208.409122:0:8861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8861:1874203867378432:0@lo:5: 00000100:00100000:1.0:1787380208.409283:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867378176 00000100:00100000:1.0:1787380208.409289:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867378176 00000100:00100000:1.0:1787380208.409319:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787380208.409326:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1874203867378176:12345-0@lo:13: 00002000:00000024:1.0:1787380208.409341:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923812352 avail 3692290048 00000100:00100000:2.0:1787380208.409384:0:8861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380208.413502:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1874203867378176:12345-0@lo:13: Request processed in 4169us (4522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380208.413524:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787380208.414537:0:8861:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380208.414575:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787380208.414583:0:8436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:3.0:1787380208.414920:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787380208.414926:0:8435:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787380208.414978:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8869:x1874203867378304:12345-0@lo:7: Request processed in 6942us (7017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380208.414986:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380208.415004:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867378432 00000100:00100000:3.0:1787380208.416580:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867378432 00000100:00100000:3.0:1787380208.416633:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787380208.416643:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8861:x1874203867378432:12345-0@lo:5: 00002000:00080000:3.0:1787380208.417582:0:8435:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1787380208.417658:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8861:x1874203867378432:12345-0@lo:5: Request processed in 1015us (8272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380208.417667:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787380208.417706:0:8869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb85cd80 going to sleep for 11 seconds 00010000:00080000:3.0:1787380208.417737:0:8869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5d9b800 x1874203867378304/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787380224 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380208.417762:0:8869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8869:1874203867378304:0@lo:7: 00000004:00080000:3.0:1787380208.417774:0:8869:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787380208.417838:0:8869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8869:1874203867378560:0@lo:5: 00000100:00100000:3.0:1787380208.417871:0:8869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380208.417888:0:8869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb85cd80 going to sleep for 11 seconds 00010000:00080000:2.0:1787380208.417978:0:8861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec20a5880 x1874203867378432/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787380224 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380208.417989:0:8861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8861:1874203867378432:0@lo:5: 00000004:00080000:2.0:1787380208.417998:0:8861:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1787380208.418031:0:8861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8861:1874203867378688:0@lo:5: 00000100:00100000:2.0:1787380208.418054:0:8861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380208.418079:0:8861:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380208.418091:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867378560 00000100:00100000:2.0:1787380208.418096:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867378560 00000100:00100000:2.0:1787380208.418123:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867378688 00000100:00100000:2.0:1787380208.418126:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867378688 00000100:00100000:2.0:1787380208.418263:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787380208.418273:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8869:x1874203867378560:12345-0@lo:5: 00002000:00080000:2.0:1787380208.418288:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787380208.418291:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00010000:00080000:0.0:1787380208.419659:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3ff8000 x1874203867378176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380208.419680:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867378176:0@lo:13: 00000100:00100000:3.0:1787380208.419866:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787380208.419878:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8861:x1874203867378688:12345-0@lo:5: 00002000:00080000:3.0:1787380208.419910:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787380208.428259:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8861:x1874203867378688:12345-0@lo:5: Request processed in 8379us (10198us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787380208.428271:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787380208.430477:0:8861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec20a5880 x1874203867378688/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787380224 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380208.430496:0:8861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8861:1874203867378688:0@lo:5: 00000004:00080000:2.0:1787380208.430519:0:8861:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1787380208.430617:0:8861:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8861:1874203867378816:0@lo:900: 00000100:00100000:2.0:1787380208.430666:0:8861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380208.430698:0:8861:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380208.430763:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867378816 00000100:00100000:0.0:1787380208.430770:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867378816 00000100:00100000:0.0:1787380208.430895:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787380208.430903:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8861:x1874203867378816:12345-0@lo:900: 00000100:00100000:0.0:1787380208.430954:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8861:x1874203867378816:12345-0@lo:900: Request processed in 51us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380208.430960:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787380208.431064:0:8861:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec20a4000 x1874203867378816/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787380224 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380208.431075:0:8861:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8861:1874203867378816:0@lo:900: 00000001:00080000:3.0:1787380208.431282:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1787380208.431293:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787380208.432839:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8869:x1874203867378560:12345-0@lo:5: Request processed in 14561us (14960us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787380208.432851:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787380208.432903:0:8869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5d9b800 x1874203867378560/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787380224 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380208.432913:0:8869:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787380208.432918:0:8869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d9b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8869:1874203867378560:0@lo:5: 00000004:00080000:2.0:1787380208.432932:0:8869:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787380208.432969:0:8869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8869:1874203867378944:0@lo:700: 00000100:00100000:2.0:1787380208.433672:0:8869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380208.433715:0:8869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380208.433785:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867378944 00000100:00100000:0.0:1787380208.433793:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867378944 00000100:00100000:0.0:1787380208.433858:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787380208.433867:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8869:x1874203867378944:12345-0@lo:700: 00000001:00080000:3.0:1787380208.439029:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:2.0:1787380208.439199:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8869:x1874203867378944:12345-0@lo:700: Request processed in 5329us (5524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380208.439229:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787380208.439439:0:8869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec20a4000 x1874203867378944/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787380224 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380208.439464:0:8869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8869:1874203867378944:0@lo:700: 00000004:02000040:3.0:1787380208.441250:0:8869:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:3.0:1787380208.447976:0:8869:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8869:1874203867379072:0@lo:5: 00000100:00100000:3.0:1787380208.449210:0:8869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380208.449251:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867379072 00000100:00100000:3.0:1787380208.449257:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867379072 00000100:00100000:3.0:1787380208.449323:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787380208.449333:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8869:x1874203867379072:12345-0@lo:5: 00000100:00100000:2.0:1787380208.450592:0:8869:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e516c0 going to sleep for 11 seconds 00002000:00080000:3.0:1787380208.461578:0:8871:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1787380208.461599:0:8871:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1787380208.465426:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8869:x1874203867379072:12345-0@lo:5: Request processed in 16088us (16211us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787380208.465447:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787380208.469601:0:8869:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5d99500 x1874203867379072/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787380224 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380208.469622:0:8869:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8869:1874203867379072:0@lo:5: 00000004:00080000:3.0:1787380208.469636:0:8869:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1787380208.716279:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787380209.188191:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:0.0:1787380209.740943:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380209.805030:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867379200:0@lo:41: 00000100:00100000:1.0:1787380209.805118:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380209.805200:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867379200 00000100:00100000:2.0:1787380209.805209:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867379200 00000100:00100000:2.0:1787380209.805290:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787380209.805300:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867379200:12345-0@lo:41: 00000004:00000024:2.0:1787380209.805335:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787380209.811332:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867379200:12345-0@lo:41: Request processed in 6026us (6206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380209.811345:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787380209.817135:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867379200:0@lo:41: 00010000:00010000:1.0:1787380210.766352:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787380211.176600:0:8966:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787380211.178469:0:8966:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787380211.787977:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787380212.135469:0:9014:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787380212.135479:0:9014:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1787380212.821369:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380213.388299:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867379712:0@lo:400: 00000100:00100000:1.0:1787380213.388377:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380213.388420:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec2607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867380224:0@lo:400: 00000100:00100000:1.0:1787380213.388443:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380213.388471:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787380213.388489:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867379328:0@lo:400: 00000100:00100000:1.0:1787380213.388516:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380213.388550:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867379840:0@lo:400: 00000100:00100000:1.0:1787380213.388571:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380213.388604:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec2605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867380352:0@lo:400: 00000100:00100000:1.0:1787380213.388627:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380213.388654:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867379456:0@lo:400: 00000100:00100000:1.0:1787380213.388676:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380213.388691:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867379968:0@lo:400: 00000100:00100000:1.0:1787380213.388710:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380213.388736:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787380213.388742:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867379584:0@lo:400: 00000100:00100000:1.0:1787380213.388762:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380213.388778:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec2605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1874203867380096:0@lo:400: 00000100:00100000:1.0:1787380213.388797:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380213.389232:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867379840 00000100:00100000:0.0:1787380213.389240:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867379840 00000100:00100000:0.0:1787380213.389281:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867379584 00000100:00100000:0.0:1787380213.389285:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867379584 00000100:00100000:0.0:1787380213.389311:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787380213.389319:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867379840:12345-0@lo:400: 00000100:00100000:0.0:1787380213.389377:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867379840:12345-0@lo:400: Request processed in 58us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380213.389383:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787380213.389399:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787380213.389405:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867379584:12345-0@lo:400: 00000100:00100000:0.0:1787380213.389433:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867379584:12345-0@lo:400: Request processed in 29us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380213.389438:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787380213.389474:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867379840:0@lo:400: 00000100:00100000:0.0:1787380213.389515:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867379712 00000100:00100000:0.0:1787380213.389519:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867379712 00000100:00100000:0.0:1787380213.389536:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867379456 00000100:00100000:0.0:1787380213.389539:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867379456 00000100:00100000:0.0:1787380213.389547:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867379968 00000100:00100000:0.0:1787380213.389549:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867379968 00000100:00100000:0.0:1787380213.389568:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867380096 00000100:00100000:0.0:1787380213.389570:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867380096 00000100:00100000:0.0:1787380213.389583:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787380213.389588:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867379712:12345-0@lo:400: 00000100:00100000:0.0:1787380213.389623:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2605c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867379712:12345-0@lo:400: Request processed in 35us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380213.389630:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787380213.389640:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787380213.389645:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867379456:12345-0@lo:400: 00000100:00100000:0.0:1787380213.389678:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2605500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867379456:12345-0@lo:400: Request processed in 33us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380213.389683:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787380213.389693:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787380213.389699:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867379968:12345-0@lo:400: 00000100:00100000:0.0:1787380213.389734:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2606680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867379968:12345-0@lo:400: Request processed in 25us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380213.389740:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787380213.389751:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787380213.389757:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874203867380096:12345-0@lo:400: 00000100:00100000:0.0:1787380213.389783:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2605880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874203867380096:12345-0@lo:400: Request processed in 27us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380213.389788:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787380213.389806:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867380224 00000100:00100000:0.0:1787380213.390749:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867380224 00010000:00080000:1.0:1787380213.391109:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec2605f80 x1874203867380096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380213.391132:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec2605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1874203867380096:0@lo:400: 00010000:00080000:1.0:1787380213.391146:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3fc2a00 x1874203867379456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380213.391153:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867379456:0@lo:400: 00010000:00080000:1.0:1787380213.391164:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3fc0a80 x1874203867379968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380213.391171:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867379968:0@lo:400: 00000100:00100000:1.0:1787380213.391197:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867379584:0@lo:400: 00000100:00100000:3.0:1787380213.397870:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867379328 00000100:00100000:3.0:1787380213.398498:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867379328 00000100:00100000:3.0:1787380213.398703:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787380213.398714:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:3639:x1874203867379328:12345-0@lo:400: 00000100:00100000:3.0:1787380213.398803:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:3639:x1874203867379328:12345-0@lo:400: Request processed in 91us (10285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380213.398835:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1787380213.399464:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787380213.399471:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787380213.399665:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380213.399711:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867379328:0@lo:400: 00010000:00080000:3.0:1787380213.399740:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3fc2680 x1874203867379712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380213.399753:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867379712:0@lo:400: 00000100:00100000:3.0:1787380213.399848:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380213.399861:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867380480:0@lo:41: 00000100:00100000:3.0:1787380213.400839:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380213.400976:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867380480 00000100:00100000:3.0:1787380213.400982:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867380480 00000100:00100000:3.0:1787380213.401015:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787380213.401032:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867380480:12345-0@lo:41: 00000004:00000024:3.0:1787380213.401060:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1787380213.401096:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867380480:12345-0@lo:41: Request processed in 65us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380213.401102:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787380213.401140:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867380480:0@lo:41: 00000100:00100000:0.0:1787380213.403363:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867380352 00000100:00100000:0.0:1787380213.403374:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867380352 00000100:00080000:3.0:1787380213.404048:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380213.404182:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380213.404194:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867380224:12345-0@lo:400: 00000100:00100000:2.0:1787380213.404273:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867380224:12345-0@lo:400: Request processed in 82us (15828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380213.404280:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380213.404296:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787380213.404316:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867380352:12345-0@lo:400: 00000100:00100000:2.0:1787380213.404345:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867380352:12345-0@lo:400: Request processed in 43us (15717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380213.404350:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787380213.404451:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec2605180 x1874203867380352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380213.404462:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1787380213.404477:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec2605180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867380352:0@lo:400: 00010000:00080000:2.0:1787380213.404489:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec2607b80 x1874203867380224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380213.404496:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787380213.404504:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec2607b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867380224:0@lo:400: 00010000:00010000:1.0:1787380213.836021:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380213.900149:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787380213.900174:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867380608:0@lo:13: 00000100:00100000:1.0:1787380213.900257:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380213.900275:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867380736:0@lo:13: 00000100:00100000:3.0:1787380213.900310:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380213.900386:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867380608 00000100:00100000:3.0:1787380213.900392:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867380608 00000100:00100000:3.0:1787380213.900425:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867380736 00000100:00100000:3.0:1787380213.900428:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867380736 00000100:00100000:3.0:1787380213.900440:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380213.900447:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867380608:12345-0@lo:13: 00002000:00000024:3.0:1787380213.900482:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380213.900517:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2605f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867380608:12345-0@lo:13: Request processed in 69us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380213.900523:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380213.900538:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380213.900543:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867380736:12345-0@lo:13: 00002000:00000024:3.0:1787380213.900551:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1787380213.900579:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5d99880 x1874203867380608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380213.900580:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867380736:12345-0@lo:13: Request processed in 35us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380213.900595:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787380213.900609:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867380608:0@lo:13: 00010000:00080000:3.0:1787380213.900627:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec20a5880 x1874203867380736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380213.900655:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867380736:0@lo:13: 00010000:00010000:2.0:1787380214.860762:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380214.924968:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380214.924992:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec2606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867380864:0@lo:41: 00000100:00100000:1.0:1787380214.925054:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380214.925127:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867380864 00000100:00100000:1.0:1787380214.925137:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867380864 00000100:00100000:1.0:1787380214.925176:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787380214.925183:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867380864:12345-0@lo:41: 00000004:00000024:1.0:1787380214.925212:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1787380214.925269:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867380864:12345-0@lo:41: Request processed in 86us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380214.925275:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787380214.925326:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec2606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867380864:0@lo:41: 00010000:00010000:0.0:1787380215.884601:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380216.911088:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380217.932132:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380218.508988:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867380992:0@lo:41: 00000100:00100000:1.0:1787380218.509071:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380218.509305:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867381504:0@lo:400: 00000100:00100000:1.0:1787380218.509333:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380218.509466:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867381120:0@lo:400: 00000100:00100000:0.0:1787380218.509500:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380218.509524:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867381632:0@lo:400: 00000100:00100000:0.0:1787380218.509544:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380218.509557:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867382144:0@lo:400: 00000100:00100000:0.0:1787380218.509576:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380218.509606:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867381120 00000100:00100000:0.0:1787380218.509625:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867381120 00000100:00100000:0.0:1787380218.509669:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787380218.509677:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:3642:x1874203867381120:12345-0@lo:400: 00000100:00100000:0.0:1787380218.509735:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:3642:x1874203867381120:12345-0@lo:400: Request processed in 58us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380218.509742:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787380218.509774:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867380992 00000100:00100000:0.0:1787380218.509779:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867380992 00000100:00100000:0.0:1787380218.509796:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867381632 00000100:00100000:0.0:1787380218.509798:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867381632 00000100:00100000:0.0:1787380218.509826:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787380218.509833:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867380992:12345-0@lo:41: 00000004:00000024:0.0:1787380218.509856:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1787380218.509887:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867380992:12345-0@lo:41: Request processed in 55us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380218.509892:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787380218.509902:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787380218.509907:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867381632:12345-0@lo:400: 00000100:00100000:0.0:1787380218.509929:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867381632:12345-0@lo:400: Request processed in 22us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380218.509934:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787380218.509949:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867382144 00000100:00100000:0.0:1787380218.509952:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867382144 00000100:00100000:0.0:1787380218.509980:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787380218.509985:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867382144:12345-0@lo:400: 00000100:00100000:0.0:1787380218.510009:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867382144:12345-0@lo:400: Request processed in 24us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380218.510014:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787380218.510038:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380218.510058:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867381120:0@lo:400: 00000100:00100000:0.0:1787380218.510068:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867381632:0@lo:400: 00010000:00080000:0.0:1787380218.510077:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5d99880 x1874203867382144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380218.510086:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867382144:0@lo:400: 00000100:00100000:1.0:1787380218.510281:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867382016:0@lo:400: 00000100:00100000:1.0:1787380218.510305:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380218.510327:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867380992:0@lo:41: 00000100:00100000:1.0:1787380218.510360:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867381248:0@lo:400: 00000100:00100000:1.0:1787380218.510384:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380218.510430:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867382016 00000100:00100000:0.0:1787380218.510434:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867382016 00000100:00100000:0.0:1787380218.510479:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787380218.510486:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867382016:12345-0@lo:400: 00000100:00100000:0.0:1787380218.510522:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867382016:12345-0@lo:400: Request processed in 36us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380218.510528:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787380218.510545:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380218.512421:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867381376:0@lo:400: 00000100:00100000:2.0:1787380218.512491:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380218.512518:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867381888:0@lo:400: 00000100:00100000:0.0:1787380218.515553:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867381376 00000100:00100000:0.0:1787380218.515566:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867381376 00000100:00100000:0.0:1787380218.515622:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787380218.515631:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867381376:12345-0@lo:400: 00000100:00100000:0.0:1787380218.515729:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867381376:12345-0@lo:400: Request processed in 99us (3237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380218.515737:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1787380218.516437:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5d99c00 x1874203867382016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380218.516465:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867382016:0@lo:400: 00000100:00100000:1.0:1787380218.519307:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380218.522660:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867381504 00000100:00100000:3.0:1787380218.522675:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867381504 00000100:00100000:3.0:1787380218.522768:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867381248 00000100:00100000:3.0:1787380218.522771:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867381248 00000100:00100000:3.0:1787380218.522790:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787380218.522870:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867381504:12345-0@lo:400: 00000100:00100000:3.0:1787380218.522961:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2604000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867381504:12345-0@lo:400: Request processed in 163us (13626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380218.522968:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787380218.522984:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787380218.522989:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867381248:12345-0@lo:400: 00000100:00100000:3.0:1787380218.523013:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2606300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867381248:12345-0@lo:400: Request processed in 25us (12629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380218.523018:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787380218.523916:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5d98380 x1874203867381504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380218.523934:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867381504:0@lo:400: 00000100:00100000:1.0:1787380218.525261:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867381376:0@lo:400: 00000100:00100000:1.0:1787380218.525291:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867381888 00000100:00100000:1.0:1787380218.525296:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867381888 00000100:00100000:1.0:1787380218.525338:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787380218.525415:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867381888:12345-0@lo:400: 00000100:00100000:1.0:1787380218.525529:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2607100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867381888:12345-0@lo:400: Request processed in 117us (6229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380218.525536:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1787380218.525554:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787380218.525570:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5d99180 x1874203867381888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380218.525593:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867381888:0@lo:400: 00010000:00080000:1.0:1787380218.525619:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5d9a300 x1874203867381248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380218.525627:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867381248:0@lo:400: 00000100:00100000:1.0:1787380218.525636:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867381760:0@lo:400: 00000100:00100000:1.0:1787380218.525662:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380218.525676:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867381760 00000100:00100000:1.0:1787380218.525679:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867381760 00000100:00100000:1.0:1787380218.525717:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787380218.525723:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867381760:12345-0@lo:400: 00000100:00100000:1.0:1787380218.525748:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2604380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867381760:12345-0@lo:400: Request processed in 26us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380218.525753:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787380218.525766:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787380218.525780:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5d9bb80 x1874203867381760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380218.525788:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867381760:0@lo:400: 00010000:00010000:3.0:1787380218.960800:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380219.020850:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867382272:0@lo:13: 00000100:00100000:1.0:1787380219.020919:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380219.021045:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867382272 00000100:00100000:0.0:1787380219.021053:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867382272 00000100:00100000:0.0:1787380219.021113:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787380219.021121:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867382272:12345-0@lo:13: 00002000:00000024:0.0:1787380219.021147:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380219.021192:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2607b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867382272:12345-0@lo:13: Request processed in 72us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380219.021198:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787380219.021343:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec20a5180 x1874203867382272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380219.021362:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867382272:0@lo:13: 00000100:00100000:1.0:1787380219.021378:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380219.021391:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867382400:0@lo:13: 00000100:00100000:1.0:1787380219.021417:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380219.024638:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867382400 00000100:00100000:0.0:1787380219.024652:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867382400 00000100:00100000:0.0:1787380219.024715:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787380219.024726:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867382400:12345-0@lo:13: 00002000:00000024:0.0:1787380219.024750:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380219.024925:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2605180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867382400:12345-0@lo:13: Request processed in 201us (3505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380219.024932:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787380219.027667:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec20a5f80 x1874203867382400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380219.027690:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867382400:0@lo:13: 00010000:00010000:0.0:1787380219.989121:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380220.043979:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787380220.049220:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867382528:0@lo:41: 00000100:00100000:2.0:1787380220.049293:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380220.049396:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867382528 00000100:00100000:0.0:1787380220.049405:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867382528 00000100:00100000:0.0:1787380220.049462:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787380220.049471:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867382528:12345-0@lo:41: 00000004:00000024:0.0:1787380220.049505:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1787380220.049556:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867382528:12345-0@lo:41: Request processed in 86us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380220.049563:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787380220.049741:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867382528:0@lo:41: 00010000:00010000:2.0:1787380221.005928:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787380221.562542:0:9513:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787380221.562547:0:9513:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1787380221.562548:0:9513:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1787380221.562795:0:9513:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d6fff5a3000 00000020:01000004:3.0:1787380221.563043:0:9513:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787380221.563057:0:9513:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787380221.563070:0:9513:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9d6ffc958000) 00000020:00000080:3.0:1787380221.563087:0:9513:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787380221.631615:0:9513:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787380221.631672:0:9513:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1787380221.680415:0:9513:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787380221.680636:0:9513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787380221.680769:0:9513:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787380221.680787:0:9513:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf3c46fdcad68b7c 00000020:01000004:0.0:1787380221.680794:0:9513:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787380221.680892:0:9513:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.130@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787380221.680896:0:9513:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787380221.680902:0:9513:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787380221.680928:0:9513:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1787380221.680995:0:9513:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787380221.706533:0:9513:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787380221.706573:0:9513:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.130@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787380221.706577:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787380221.706578:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787380221.706580:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380221.706581:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380221.706582:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380221.706583:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380221.706584:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787380221.706585:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787380221.706587:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787380221.706588:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380221.706590:0:9513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787380221.706593:0:9513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787380221.706595:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787380221.706597:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787380221.706598:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380221.706603:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380221.706604:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380221.706605:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380221.706606:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787380221.706607:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787380221.706608:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787380221.706609:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380221.706610:0:9513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787380221.706635:0:9513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787380221.706733:0:9513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867382656:0@lo:253: 00000100:00100000:2.0:1787380221.706836:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380221.706871:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867382656 00000100:00100000:3.0:1787380221.706878:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867382656 00000100:00100000:2.0:1787380221.706878:0:9513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd27a8780 going to sleep for 11 seconds 00000100:00100000:3.0:1787380221.706935:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787380221.706944:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:9513:x1874203867382656:12345-0@lo:253: 20000000:01000000:3.0:1787380221.706977:0:6516:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787380221.706981:0:6516:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787380221.706985:0:6516:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787380221.706988:0:6516:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787380221.707204:0:6516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787380221.707567:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1787380221.707581:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787380221.707599:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1787380221.707605:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787380221.707618:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1787380221.707634:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1787380221.708394:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1787380221.708414:0:6516:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.206.130@tcp 20000000:01000000:2.0:1787380221.708416:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.130@tcp (null) (null) (null) 00000040:00080000:2.0:1787380221.708499:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1787380221.708512:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787380221.708532:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1787380221.708541:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.130@tcp (null) (null) 00000040:00080000:2.0:1787380221.708556:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1787380221.708567:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787380221.708581:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1787380221.708601:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1787380221.708767:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1787380221.708779:0:6516:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.206.130@tcp 20000000:01000000:2.0:1787380221.708781:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.130@tcp (null) (null) (null) 00000040:00080000:2.0:1787380221.708796:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1787380221.708802:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787380221.708855:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1787380221.708862:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.206.130@tcp (null) (null) 00000040:00080000:2.0:1787380221.708874:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1787380221.708880:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787380221.708890:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1787380221.708913:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1787380221.709344:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1787380221.709358:0:6516:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.206.130@tcp 20000000:01000000:2.0:1787380221.709360:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.130@tcp (null) (null) (null) 00000040:00080000:2.0:1787380221.709374:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1787380221.709379:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787380221.709392:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1787380221.709397:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.130@tcp (null) (null) 00000040:00080000:2.0:1787380221.709409:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1787380221.709415:0:6516:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1787380221.709426:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1787380221.709522:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1787380221.709536:0:6516:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787380221.709538:0:6516:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787380221.709541:0:6516:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787380221.709581:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787380221.709584:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787380221.710113:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1787380221.710135:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1787380221.710149:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1787380221.710310:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1787380221.710329:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1787380221.710343:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1787380221.710351:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787380221.710353:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787380221.716334:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:2.0:1787380221.716506:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:2.0:1787380221.716542:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:2.0:1787380221.716560:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:2.0:1787380221.716570:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787380221.716573:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787380221.719036:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1787380221.719081:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1787380221.719098:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1787380221.719304:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1787380221.719328:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1787380221.719343:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1787380221.719355:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787380221.719358:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787380221.720966:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1787380221.721014:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1787380221.721049:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1787380221.721225:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1787380221.721247:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1787380221.721261:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:2.0:1787380221.721277:0:6516:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787380221.721279:0:6516:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787380221.722565:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:2.0:1787380221.722596:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:2.0:1787380221.722608:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1787380221.722910:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1787380221.722931:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1787380221.722955:0:6516:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:3.0:1787380221.722969:0:6516:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787380221.722986:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6ff5fda400/0xcf3c46fdcad68b83 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.723002:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68a79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a72 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.723017:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe0a9b400/0xcf3c46fdcad68aa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a9c expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.723024:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68ae2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68adb expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.723031:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ffb89d600/0xcf3c46fdcad68afe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68af7 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.723037:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc0031400/0xcf3c46fdcad68b28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68b21 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.723044:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68b44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68b3d expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.723051:0:6516:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe0a9a400/0xcf3c46fdcad68b6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68b67 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.723058:0:6516:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6ff5fda400/0xcf3c46fdcad68b83 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.723091:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe0a9a400/0xcf3c46fdcad68b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68b67 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.723103:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fe0a9a400/0xcf3c46fdcad68b6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b67 expref: 21 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.723116:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d98380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874203867382784:0@lo:104: 00000100:00100000:3.0:1787380221.723175:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787380221.723227:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68b3d expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.723235:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68b44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b3d expref: 21 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.723243:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d9aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874203867382912:0@lo:104: 00000100:00100000:3.0:1787380221.723264:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787380221.723283:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc0031400/0xcf3c46fdcad68b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68b21 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.723291:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc0031400/0xcf3c46fdcad68b28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b21 expref: 21 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.723298:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d9bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874203867383040:0@lo:104: 00000100:00100000:3.0:1787380221.723317:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787380221.723344:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ffb89d600/0xcf3c46fdcad68afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68af7 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.723352:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6ffb89d600/0xcf3c46fdcad68afe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68af7 expref: 21 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.723360:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874203867383168:0@lo:104: 00000100:00100000:3.0:1787380221.723376:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787380221.723387:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68adb expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.723394:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68ae2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68adb expref: 21 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.723401:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874203867383296:0@lo:104: 00000100:00100000:3.0:1787380221.723422:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380221.723482:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867382784 00000100:00100000:0.0:1787380221.723490:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867382784 00000100:00100000:0.0:1787380221.723521:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867382912 00000100:00100000:0.0:1787380221.723524:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867382912 00000100:00100000:0.0:1787380221.723533:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867383040 00000100:00100000:0.0:1787380221.723535:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867383040 00000100:00100000:0.0:1787380221.723543:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867383168 00000100:00100000:0.0:1787380221.723545:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867383168 00000100:00100000:0.0:1787380221.723553:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867383296 00000100:00100000:0.0:1787380221.723555:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867383296 00000100:00100000:0.0:1787380221.723568:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1787380221.723571:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe0a9b400/0xcf3c46fdcad68aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68a9c expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380221.723580:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+7:6516:x1874203867382784:12345-0@lo:104: 00010000:00010000:3.0:1787380221.723585:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fe0a9b400/0xcf3c46fdcad68aa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a9c expref: 21 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.723594:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68b6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.723596:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874203867383424:0@lo:104: 00000100:00100000:3.0:1787380221.723628:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787380221.723663:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787380221.723670:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+7:6516:x1874203867382784:12345-0@lo:104: Request processed in 94us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380221.723677:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787380221.723707:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787380221.723715:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867383424 00000100:00100000:0.0:1787380221.723725:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867383424 00010000:00010000:3.0:1787380221.723736:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380221.723743:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68b6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380221.723744:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1787380221.723755:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9ae00 already unused, calling callback (ffffffffc13abc20) 00000100:00100000:0.0:1787380221.723755:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+7:6516:x1874203867382912:12345-0@lo:104: 10000000:00010000:3.0:1787380221.723763:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68b6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.723766:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9a600/0xcf3c46fdcad68b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.723774:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68b6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380221.723782:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68b6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380221.723788:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787380221.723844:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1787380221.723846:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68b67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68b6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380221.723853:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+7:6516:x1874203867382912:12345-0@lo:104: Request processed in 98us (585us total) trans 0 rc 0/0 00010000:00010000:3.0:1787380221.723859:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787380221.723864:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787380221.723879:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1787380221.723882:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68b67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68b6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380221.723888:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+6:6516:x1874203867383040:12345-0@lo:104: 00010000:00010000:0.0:1787380221.723898:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68b28 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.723921:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68b67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68b6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.723941:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787380221.723946:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+6:6516:x1874203867383040:12345-0@lo:104: Request processed in 62us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380221.723953:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787380221.723964:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787380221.723969:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:6516:x1874203867383168:12345-0@lo:104: 00010000:00010000:0.0:1787380221.723976:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68afe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.724001:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787380221.724007:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:6516:x1874203867383168:12345-0@lo:104: Request processed in 38us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380221.724014:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1787380221.724055:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787380221.724060:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9a600/0xcf3c46fdcad68b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724066:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9a600 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380221.724070:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9a600/0xcf3c46fdcad68b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724076:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9a600/0xcf3c46fdcad68b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380221.724083:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9a600/0xcf3c46fdcad68b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380221.724087:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380221.724108:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9a600/0xcf3c46fdcad68b3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724114:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380221.724129:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9a600/0xcf3c46fdcad68b3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724135:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9a600/0xcf3c46fdcad68b3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68b44 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724144:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787380221.724153:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68b28 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724159:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165bc00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380221.724162:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68b28 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724168:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68b28 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380221.724174:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68b28 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380221.724179:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380221.724206:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68b21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68b28 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724212:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380221.724217:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68b21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68b28 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724223:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68b21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68b28 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724232:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380221.724236:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68afe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724242:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c800 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380221.724245:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68afe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724261:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68afe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380221.724267:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68afe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380221.724271:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380221.724286:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68af7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68afe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724292:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380221.724297:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68af7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68afe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724304:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68af7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68afe expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724313:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380221.724315:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380221.724316:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380221.724335:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867383552:0@lo:103: 00000100:00100000:3.0:1787380221.724361:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380221.724388:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380221.724393:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867383936:0@lo:103: 00000100:00100000:3.0:1787380221.724407:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380221.724428:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867383680:0@lo:103: 00000100:00100000:3.0:1787380221.724459:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380221.724472:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380221.724483:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867383808:0@lo:103: 00000100:00100000:3.0:1787380221.724502:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380221.724520:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867383552 00000100:00100000:3.0:1787380221.724523:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867383552 00010000:00010000:3.0:1787380221.724548:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe0a9a400/0xcf3c46fdcad68b6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b67 expref: 22 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.724560:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867383936 00000100:00100000:3.0:1787380221.724562:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867383936 00010000:00010000:3.0:1787380221.724570:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ffb89d600/0xcf3c46fdcad68afe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68af7 expref: 23 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.724578:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867383680 00000100:00100000:3.0:1787380221.724580:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867383680 00010000:00010000:3.0:1787380221.724587:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68b44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b3d expref: 24 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.724594:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867383808 00000100:00100000:3.0:1787380221.724596:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867383808 00010000:00010000:3.0:1787380221.724603:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc0031400/0xcf3c46fdcad68b28 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b21 expref: 25 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.724612:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787380221.724617:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+25:3642:x1874203867383552:12345-0@lo:103: 00010000:00010000:3.0:1787380221.724625:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380221.724629:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe0a9a400/0xcf3c46fdcad68b6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b67 expref: 25 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724638:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe0a9a400/0xcf3c46fdcad68b6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b67 expref: 25 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724665:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380221.724707:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+25:3642:x1874203867383552:12345-0@lo:103: Request processed in 89us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380221.724714:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787380221.724727:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787380221.724732:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec310b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3642:x1874203867383936:12345-0@lo:103: 00010000:00010000:3.0:1787380221.724739:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380221.724742:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ffb89d600/0xcf3c46fdcad68afe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68af7 expref: 24 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724750:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ffb89d600/0xcf3c46fdcad68afe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68af7 expref: 24 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724759:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380221.724780:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec310b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3642:x1874203867383936:12345-0@lo:103: Request processed in 47us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380221.724785:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787380221.724796:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787380221.724801:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3108000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:3639:x1874203867383680:12345-0@lo:103: 00010000:00010000:3.0:1787380221.724825:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380221.724829:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68b44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b3d expref: 23 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724837:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68b44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b3d expref: 23 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724846:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380221.724866:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3108000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:3639:x1874203867383680:12345-0@lo:103: Request processed in 66us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380221.724872:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787380221.724887:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787380221.724893:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:3639:x1874203867383808:12345-0@lo:103: 00010000:00010000:3.0:1787380221.724900:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380221.724904:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc0031400/0xcf3c46fdcad68b28 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b21 expref: 22 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724912:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc0031400/0xcf3c46fdcad68b28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b21 expref: 22 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.724921:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380221.724956:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:3639:x1874203867383808:12345-0@lo:103: Request processed in 63us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380221.724962:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787380221.725021:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867383808:0@lo:103: 00000100:00100000:3.0:1787380221.725029:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867383680:0@lo:103: 00000100:00100000:3.0:1787380221.725048:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867383936:0@lo:103: 00000100:00100000:3.0:1787380221.725054:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867383552:0@lo:103: 00010000:00010000:3.0:1787380221.725069:0:6516:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68a72 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.725078:0:6516:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68a79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a72 expref: 21 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.725088:0:6516:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874203867384064:0@lo:104: 00000100:00100000:3.0:1787380221.725108:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380221.725119:0:6516:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4c99240 going to sleep for 11 seconds 00010000:00010000:3.0:1787380221.725131:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9a400/0xcf3c46fdcad68b6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68b67 expref: 21 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.725147:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d98380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874203867382784:0@lo:104: 00010000:00010000:3.0:1787380221.725158:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68b44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68b3d expref: 20 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.725165:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d9aa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874203867382912:0@lo:104: 00010000:00010000:3.0:1787380221.725172:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc0031400/0xcf3c46fdcad68b28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68b21 expref: 19 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.725178:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d9bb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874203867383040:0@lo:104: 00010000:00010000:3.0:1787380221.725184:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffb89d600/0xcf3c46fdcad68afe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68af7 expref: 18 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.725191:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874203867383168:0@lo:104: 00000100:00100000:2.0:1787380221.726409:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867384064 00000100:00100000:2.0:1787380221.726419:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867384064 00010000:00010000:3.0:1787380221.726565:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380221.730910:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380221.731003:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787380221.731022:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787380221.731043:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:6516:x1874203867383296:12345-0@lo:104: 00000100:00100000:0.0:1787380221.731061:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec24d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:6516:x1874203867383424:12345-0@lo:104: 00010000:00010000:1.0:1787380221.731064:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68ae2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.731074:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68aa3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.731222:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787380221.731229:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec24d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:6516:x1874203867383424:12345-0@lo:104: Request processed in 197us (7600us total) trans 0 rc 0/0 00010000:00010000:1.0:1787380221.731233:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787380221.731238:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787380221.731244:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:6516:x1874203867383296:12345-0@lo:104: Request processed in 228us (7818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380221.731254:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787380221.731269:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787380221.731278:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3109880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:6516:x1874203867384064:12345-0@lo:104: 00010000:00010000:0.0:1787380221.731287:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ac00/0xcf3c46fdcad68a72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68a79 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.731302:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787380221.731308:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68aa3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.731317:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89da00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:1.0:1787380221.731322:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68aa3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.731328:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1787380221.731331:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68aa3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380221.731337:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3109880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:6516:x1874203867384064:12345-0@lo:104: Request processed in 60us (6226us total) trans 0 rc 0/0 10000000:00010000:1.0:1787380221.731345:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68aa3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380221.731349:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 10000000:01000000:1.0:1787380221.731357:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787380221.731394:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68a9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68aa3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.731401:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380221.731431:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68a9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68aa3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.731439:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68a9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68aa3 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.731450:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787380221.731454:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68ae2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.731459:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165be00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:1.0:1787380221.731462:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68ae2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.731469:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68ae2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380221.731476:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68ae2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380221.731481:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787380221.731496:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68adb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68ae2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.731501:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380221.731528:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68adb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68ae2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.731535:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68adb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68ae2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.731537:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874203867383424:0@lo:104: 00010000:00010000:1.0:1787380221.731551:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380221.731552:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380221.731562:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ac00/0xcf3c46fdcad68a72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68a79 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.731565:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874203867384064:0@lo:104: 00010000:00010000:1.0:1787380221.731573:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165ac00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:1.0:1787380221.731578:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ac00/0xcf3c46fdcad68a72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68a79 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.731581:0:6516:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6516:1874203867383296:0@lo:104: 00010000:00010000:1.0:1787380221.731593:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ac00/0xcf3c46fdcad68a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68a79 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380221.731612:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ac00/0xcf3c46fdcad68a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68a79 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.731615:0:6516:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6ff5fda400/0xcf3c46fdcad68b83 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380221.731620:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787380221.731643:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ac00/0xcf3c46fdcad68a72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68a79 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.731650:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380221.731655:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ac00/0xcf3c46fdcad68a72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68a79 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.731661:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ac00/0xcf3c46fdcad68a72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68a79 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.731675:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380221.731677:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380221.731678:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380221.731705:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787380221.731718:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867384192:0@lo:103: 00000100:00100000:0.0:1787380221.731738:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867384320:0@lo:103: 00000100:00100000:1.0:1787380221.731754:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380221.731780:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380221.731803:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867384448:0@lo:103: 00000100:00100000:3.0:1787380221.732132:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867384192 00000100:00100000:3.0:1787380221.732139:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867384192 00010000:00010000:3.0:1787380221.732161:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe0a9b400/0xcf3c46fdcad68aa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a9c expref: 18 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.732225:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867384320 00000100:00100000:3.0:1787380221.732229:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867384320 00010000:00010000:3.0:1787380221.732242:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68ae2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68adb expref: 19 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380221.732261:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380221.732278:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787380221.732286:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:3641:x1874203867384192:12345-0@lo:103: 00010000:00010000:0.0:1787380221.732297:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380221.732302:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe0a9b400/0xcf3c46fdcad68aa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a9c expref: 19 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.732312:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe0a9b400/0xcf3c46fdcad68aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a9c expref: 19 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.732333:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9b400/0xcf3c46fdcad68aa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68a9c expref: 19 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.732347:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380221.732399:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:3641:x1874203867384192:12345-0@lo:103: Request processed in 114us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380221.732406:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787380221.732420:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787380221.732426:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:3639:x1874203867384320:12345-0@lo:103: 00010000:00010000:0.0:1787380221.732433:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380221.732437:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68ae2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68adb expref: 17 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.732446:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68adb expref: 17 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.732455:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68ae2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68adb expref: 17 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.732464:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380221.732487:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:3639:x1874203867384320:12345-0@lo:103: Request processed in 62us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380221.732493:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787380221.732518:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867384320:0@lo:103: 00000100:00100000:2.0:1787380221.732673:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867384192:0@lo:103: 00000100:00100000:1.0:1787380221.733155:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380221.734059:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867384448 00000100:00100000:0.0:1787380221.734069:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867384448 00010000:00010000:0.0:1787380221.734101:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68a79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a72 expref: 16 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380221.734157:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787380221.734165:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:3640:x1874203867384448:12345-0@lo:103: 00010000:00010000:0.0:1787380221.734178:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380221.734183:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68a79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a72 expref: 16 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.734195:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a72 expref: 16 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.734210:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68a79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68a72 expref: 16 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.734224:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6ff5fda400/0xcf3c46fdcad68b83 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.734231:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5fda400/0xcf3c46fdcad68b83 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.734245:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6ff5fda400/0xcf3c46fdcad68b83 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.734252:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6ff5fda400/0xcf3c46fdcad68b83 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.734259:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6ff5fda400/0xcf3c46fdcad68b83 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.734265:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6ff5fda400/0xcf3c46fdcad68b83 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.734282:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fda400 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380221.734286:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6ff5fda400/0xcf3c46fdcad68b83 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.734294:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6ff5fda400/0xcf3c46fdcad68b83 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.734315:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6ff5fda400/0xcf3c46fdcad68b83 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.734326:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380221.734338:0:6516:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6ff5fda400/0xcf3c46fdcad68b83 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.734348:0:6516:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6ff5fda400/0xcf3c46fdcad68b83 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.734355:0:6516:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5fda400/0xcf3c46fdcad68b83 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380221.734383:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:3640:x1874203867384448:12345-0@lo:103: Request processed in 218us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380221.734390:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 20000000:01000000:3.0:1787380221.734443:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787380221.734490:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867384448:0@lo:103: 00000100:00100000:3.0:1787380221.747677:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:9513:x1874203867382656:12345-0@lo:253: Request processed in 40724us (40831us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380221.747700:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787380221.752590:0:9513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867382656:0@lo:253: 10000000:01000000:2.0:1787380221.752610:0:9513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787380221.752613:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787380221.752615:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787380221.752616:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380221.752617:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787380221.752619:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380221.752620:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380221.752621:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787380221.752623:0:9513:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787380221.752624:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380221.752626:0:9513:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787380221.752652:0:9513:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d6fff5a3000 from lustre-OST0001 10000000:01000000:2.0:1787380221.752693:0:9513:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787380221.752696:0:9513:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787380221.752705:0:9513:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d6ff8828000 local copy 10000000:01000000:2.0:1787380221.752709:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787380221.752745:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68b8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380221.752756:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68b8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380221.752766:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68b8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380221.752799:0:9513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867384576:0@lo:101: 00000100:00100000:2.0:1787380221.752874:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380221.752917:0:9513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd27a8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787380221.752978:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867384576 00000100:00100000:3.0:1787380221.752986:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867384576 00000100:00100000:3.0:1787380221.753043:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787380221.753052:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+14:9513:x1874203867384576:12345-0@lo:101: 00010000:00010000:3.0:1787380221.753065:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380221.753079:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5fda000/0xcf3c46fdcad68b91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68b8a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.753099:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5fda000/0xcf3c46fdcad68b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68b8a expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.753121:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5fda000/0xcf3c46fdcad68b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68b8a expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.753130:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fda000, rc 0) 00000100:00100000:3.0:1787380221.753174:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:9513:x1874203867384576:12345-0@lo:101: Request processed in 124us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380221.753181:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787380221.755166:0:9513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867384576:0@lo:101: 00010000:00010000:2.0:1787380221.755200:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68b8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcf3c46fdcad68b91 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380221.755211:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68b8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf3c46fdcad68b91 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380221.755323:0:9513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867384704:0@lo:501: 00000100:00100000:2.0:1787380221.755508:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380221.755548:0:9513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd27a8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787380221.756101:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867384704 00000100:00100000:3.0:1787380221.756109:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867384704 00000100:00100000:3.0:1787380221.756149:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787380221.756157:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:9513:x1874203867384704:12345-0@lo:501: 00000100:00100000:3.0:1787380221.756245:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:9513:x1874203867384704:12345-0@lo:501: Request processed in 88us (871us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787380221.756252:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787380221.756622:0:9513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867384704:0@lo:501: 10000000:01000000:2.0:1787380221.756638:0:9513:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787380221.756660:0:9513:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787380221.756667:0:9513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68b8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcf3c46fdcad68b91 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380221.756676:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68b8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf3c46fdcad68b91 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380221.756693:0:9513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68b8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcf3c46fdcad68b91 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380221.756717:0:9513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787380221.756752:0:9513:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d6fff5a3000 10000000:01000000:2.0:1787380221.756757:0:9513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787380221.756762:0:9513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787380221.756765:0:9513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787380221.756769:0:9513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787380221.756771:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787380221.756795:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad68b98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380221.756802:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad68b98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380221.756830:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad68b98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380221.756845:0:9513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867384832:0@lo:101: 00000100:00100000:2.0:1787380221.756878:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380221.756910:0:9513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd27a8000 going to sleep for 11 seconds 00000100:00100000:0.0:1787380221.757085:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867384832 00000100:00100000:0.0:1787380221.757090:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867384832 00000100:00100000:0.0:1787380221.757126:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787380221.757134:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:9513:x1874203867384832:12345-0@lo:101: 00010000:00010000:0.0:1787380221.757142:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380221.757154:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d7002045800/0xcf3c46fdcad68b9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68b98 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.757174:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d7002045800/0xcf3c46fdcad68b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68b98 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.757184:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d7002045800/0xcf3c46fdcad68b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68b98 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.757192:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d7002045800, rc 0) 00000100:00100000:0.0:1787380221.757230:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:9513:x1874203867384832:12345-0@lo:101: Request processed in 97us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380221.757236:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787380221.757708:0:9513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867384832:0@lo:101: 00010000:00010000:2.0:1787380221.757722:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad68b98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68b9f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380221.757731:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad68b98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68b9f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380221.757798:0:9513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867384960:0@lo:501: 00000100:00100000:2.0:1787380221.757859:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380221.757879:0:9513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd27a8000 going to sleep for 11 seconds 00000100:00100000:2.0:1787380221.757895:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867384960 00000100:00100000:2.0:1787380221.757906:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867384960 00000100:00100000:2.0:1787380221.757939:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787380221.757945:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:9513:x1874203867384960:12345-0@lo:501: 00010000:00010000:3.0:1787380221.758088:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380221.758095:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68b8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcf3c46fdcad68b91 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.758103:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c400 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380221.758107:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68b8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcf3c46fdcad68b91 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.758115:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcf3c46fdcad68b91 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380221.758122:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcf3c46fdcad68b91 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380221.758140:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380221.758160:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68b8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf3c46fdcad68b91 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.758166:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380221.758184:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68b8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf3c46fdcad68b91 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.758191:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68b8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcf3c46fdcad68b91 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.758203:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380221.758205:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380221.758206:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380221.758214:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380221.758224:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867385088:0@lo:103: 00000100:00100000:3.0:1787380221.758254:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380221.758287:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867385088 00000100:00100000:3.0:1787380221.758291:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867385088 00000100:00100000:3.0:1787380221.758320:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380221.758326:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:3642:x1874203867385088:12345-0@lo:103: 00010000:00010000:3.0:1787380221.758335:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380221.758346:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5fda000/0xcf3c46fdcad68b91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad68b8a expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.758355:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380221.758383:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:3642:x1874203867385088:12345-0@lo:103: Request processed in 57us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380221.758398:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380221.758430:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867385088:0@lo:103: 00000100:00100000:2.0:1787380221.759568:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:9513:x1874203867384960:12345-0@lo:501: Request processed in 1620us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380221.759578:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787380221.759617:0:9513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867384960:0@lo:501: 00000100:00100000:0.0:1787380221.759662:0:9513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867385216:0@lo:503: 00000100:00100000:0.0:1787380221.759726:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380221.759762:0:9513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc5230900 going to sleep for 11 seconds 00000100:00100000:3.0:1787380221.759832:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867385216 00000100:00100000:3.0:1787380221.759838:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867385216 00000100:00100000:3.0:1787380221.759921:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787380221.759929:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:9513:x1874203867385216:12345-0@lo:503: 00000100:00100000:3.0:1787380221.760038:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:9513:x1874203867385216:12345-0@lo:503: Request processed in 110us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380221.760045:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787380221.760108:0:9513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867385216:0@lo:503: 00000040:00080000:2.0:1787380221.760552:0:9513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787380221.760615:0:9513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867385344:0@lo:502: 00000100:00100000:2.0:1787380221.760656:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380221.770987:0:9513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd27a8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787380221.779909:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867385344 00000100:00100000:0.0:1787380221.780124:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867385344 00000100:00100000:1.0:1787380221.793176:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787380221.793190:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:9513:x1874203867385344:12345-0@lo:502: 00000100:00100000:1.0:1787380221.793355:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:9513:x1874203867385344:12345-0@lo:502: Request processed in 168us (32699us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380221.793363:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787380221.793475:0:9513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867385344:0@lo:502: 00000040:00080000:2.0:1787380221.793718:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787380221.793749:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787380221.793764:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787380221.793777:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787380221.793791:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787380221.793804:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787380221.793856:0:9513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867385472:0@lo:502: 00000100:00100000:2.0:1787380221.793902:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380221.808193:0:9513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd27a8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380221.811723:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867385472 00000100:00100000:3.0:1787380221.811739:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867385472 00000100:00100000:3.0:1787380221.811804:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787380221.811832:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:9513:x1874203867385472:12345-0@lo:502: 00000100:00100000:3.0:1787380221.812008:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:9513:x1874203867385472:12345-0@lo:502: Request processed in 179us (18106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380221.812015:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787380221.812176:0:9513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867385472:0@lo:502: 00000040:00080000:2.0:1787380221.812324:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787380221.812338:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1787380221.814174:0:9524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787380221.814186:0:9524:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1787380221.814192:0:9524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380221.814202:0:9524:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787380221.814209:0:9524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787380221.814342:0:9524:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9d6ff4c619c0) 00000020:00000080:2.0:1787380221.814368:0:9524:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787380221.814376:0:9524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787380221.814462:0:9524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6fff5a3000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787380221.814470:0:9524:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787380221.814477:0:9524:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf3c46fdcad68bad 00010000:00010000:2.0:1787380221.826331:0:9524:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1787380221.826620:0:9524:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1787380221.834877:0:9524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787380221.835475:0:9524:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787380221.846109:0:9524:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1787380221.846292:0:9524:0:(osd_compat.c:1352:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1787380221.856088:0:9524:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1787380221.857522:0:9524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787380221.857534:0:9524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380221.857541:0:9524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380221.857543:0:9524:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787380221.857547:0:9524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380221.857550:0:9524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380221.857551:0:9524:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787380221.857554:0:9524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787380221.857555:0:9524:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787380221.857576:0:9524:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380221.857579:0:9524:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380221.857580:0:9524:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787380221.857584:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787380221.857738:0:9513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787380221.857764:0:9513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787380221.857786:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad68b98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68b9f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.857797:0:9513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad68b98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68b9f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380221.857805:0:9513:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fff5a3000 from 1 10000000:01000000:3.0:1787380221.857834:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787380221.857867:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda000/0xcf3c46fdcad68bb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.857886:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda000/0xcf3c46fdcad68bb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.857898:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda000/0xcf3c46fdcad68bb4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.857921:0:9513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867385600:0@lo:101: 00000100:00100000:3.0:1787380221.858152:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380221.858197:0:9513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380221.858251:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867385600 00000100:00100000:0.0:1787380221.858259:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867385600 00000100:00100000:0.0:1787380221.858308:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787380221.858317:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:9513:x1874203867385600:12345-0@lo:101: 00010000:00010000:0.0:1787380221.858329:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380221.858342:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d7002045e00/0xcf3c46fdcad68bbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68bb4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.858363:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d7002045e00/0xcf3c46fdcad68bbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68bb4 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.858373:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d7002045e00/0xcf3c46fdcad68bbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68bb4 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.858381:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d7002045e00, rc 0) 00000100:00100000:0.0:1787380221.858425:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:9513:x1874203867385600:12345-0@lo:101: Request processed in 109us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380221.858531:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787380221.858618:0:9513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867385600:0@lo:101: 00010000:00010000:3.0:1787380221.858631:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda000/0xcf3c46fdcad68bb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68bbb expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.858639:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda000/0xcf3c46fdcad68bb4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68bbb expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.858735:0:9513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867385728:0@lo:501: 00000100:00100000:3.0:1787380221.858763:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380221.858785:0:9513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380221.858889:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867385728 00000100:00100000:0.0:1787380221.858895:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867385728 00000100:00100000:0.0:1787380221.858926:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787380221.859064:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:9513:x1874203867385728:12345-0@lo:501: 00000100:00100000:0.0:1787380221.859154:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:9513:x1874203867385728:12345-0@lo:501: Request processed in 221us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380221.859161:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787380221.859232:0:9513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867385728:0@lo:501: 00000100:00100000:3.0:1787380221.859258:0:9513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867385856:0@lo:503: 00000100:00100000:3.0:1787380221.859299:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380221.859326:0:9513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380221.859364:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867385856 00000100:00100000:0.0:1787380221.859368:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867385856 00000100:00100000:0.0:1787380221.859398:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787380221.859404:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:9513:x1874203867385856:12345-0@lo:503: 00000100:00100000:0.0:1787380221.859584:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:9513:x1874203867385856:12345-0@lo:503: Request processed in 179us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380221.859590:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787380221.859662:0:9513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867385856:0@lo:503: 00000040:00080000:3.0:1787380221.860136:0:9513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787380221.860207:0:9513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867385984:0@lo:502: 00000100:00100000:3.0:1787380221.860248:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380221.860278:0:9513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380221.862063:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867385984 00000100:00100000:0.0:1787380221.862075:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867385984 00000100:00100000:0.0:1787380221.862124:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787380221.862133:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:9513:x1874203867385984:12345-0@lo:502: 00000100:00100000:0.0:1787380221.862269:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:9513:x1874203867385984:12345-0@lo:502: Request processed in 136us (2020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380221.862277:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787380221.862398:0:9513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867385984:0@lo:502: 00000040:00080000:3.0:1787380221.862630:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787380221.862660:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787380221.862701:0:9513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867386112:0@lo:502: 00000100:00100000:3.0:1787380221.862743:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380221.862780:0:9513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380221.863091:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867386112 00000100:00100000:0.0:1787380221.863097:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867386112 00000100:00100000:0.0:1787380221.863126:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787380221.863133:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:9513:x1874203867386112:12345-0@lo:502: 00000100:00100000:0.0:1787380221.863222:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:9513:x1874203867386112:12345-0@lo:502: Request processed in 88us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380221.863238:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787380221.863628:0:9513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867386112:0@lo:502: 00000040:00080000:3.0:1787380221.863698:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787380221.863707:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787380221.864840:0:9528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380221.864851:0:9528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380221.864853:0:9528:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787380221.864859:0:9528:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6fff5a3000 00000020:00000080:0.0:1787380221.864862:0:9528:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787380221.864872:0:9528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380221.864875:0:9528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380221.864877:0:9528:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787380221.864879:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787380221.865082:0:9513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787380221.865107:0:9513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787380221.865129:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda000/0xcf3c46fdcad68bb4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68bbb expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380221.865141:0:9513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda000/0xcf3c46fdcad68bb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68bbb expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380221.865186:0:9513:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787380221.865189:0:9513:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d6fff5a3000 10000000:01000000:2.0:1787380221.865192:0:9513:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d6fff5a3000 10000000:01000000:2.0:1787380221.865196:0:9513:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787380221.865202:0:9513:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6fff5a3000 from 1 10000000:01000000:2.0:1787380221.865204:0:9513:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787380221.865233:0:9513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c200/0xcf3c46fdcad68bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380221.865240:0:9513:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c200/0xcf3c46fdcad68bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380221.865262:0:9513:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c200/0xcf3c46fdcad68bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380221.865279:0:9513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867386240:0@lo:101: 00000100:00100000:2.0:1787380221.865331:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380221.865365:0:9513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd27a8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787380221.865383:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867386240 00000100:00100000:2.0:1787380221.865389:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867386240 00000100:00100000:2.0:1787380221.865424:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787380221.866074:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:9513:x1874203867386240:12345-0@lo:101: 00010000:00010000:2.0:1787380221.866088:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380221.866101:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89d200/0xcf3c46fdcad68bc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68bc2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380221.866122:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89d200/0xcf3c46fdcad68bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68bc2 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380221.866132:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89d200/0xcf3c46fdcad68bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68bc2 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380221.866141:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89d200, rc 0) 00000100:00100000:2.0:1787380221.866230:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:9513:x1874203867386240:12345-0@lo:101: Request processed in 798us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380221.866238:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787380221.869577:0:9513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867386240:0@lo:101: 00010000:00010000:0.0:1787380221.869601:0:9513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c200/0xcf3c46fdcad68bc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68bc9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.869614:0:9513:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c200/0xcf3c46fdcad68bc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68bc9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380221.870420:0:9513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867386368:0@lo:501: 00000100:00100000:1.0:1787380221.870537:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380221.870600:0:9513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76600 going to sleep for 11 seconds 00000100:00100000:0.0:1787380221.870631:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867386368 00000100:00100000:0.0:1787380221.870637:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867386368 00000100:00100000:0.0:1787380221.870720:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787380221.870730:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:9513:x1874203867386368:12345-0@lo:501: 00000100:00100000:0.0:1787380221.870876:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:9513:x1874203867386368:12345-0@lo:501: Request processed in 148us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380221.870884:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787380221.870967:0:9513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867386368:0@lo:501: 00000100:00100000:1.0:1787380221.870995:0:9513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867386496:0@lo:503: 00000100:00100000:1.0:1787380221.871040:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380221.871256:0:9513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76600 going to sleep for 11 seconds 00000100:00100000:2.0:1787380221.871316:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867386496 00000100:00100000:2.0:1787380221.871321:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867386496 00000100:00100000:2.0:1787380221.871343:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787380221.871350:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:9513:x1874203867386496:12345-0@lo:503: 00000100:00100000:2.0:1787380221.871479:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:9513:x1874203867386496:12345-0@lo:503: Request processed in 128us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380221.871486:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787380221.871640:0:9513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867386496:0@lo:503: 00000040:00080000:1.0:1787380221.872116:0:9513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787380221.872198:0:9513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867386624:0@lo:502: 00000100:00100000:1.0:1787380221.872242:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380221.872274:0:9513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76600 going to sleep for 11 seconds 00000100:00100000:0.0:1787380221.872313:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867386624 00000100:00100000:0.0:1787380221.872319:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867386624 00000100:00100000:0.0:1787380221.872353:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787380221.872360:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:9513:x1874203867386624:12345-0@lo:502: 00000100:00100000:0.0:1787380221.872475:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:9513:x1874203867386624:12345-0@lo:502: Request processed in 114us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380221.872482:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787380221.872626:0:9513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867386624:0@lo:502: 00000040:00080000:3.0:1787380221.872799:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787380221.872852:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787380221.872864:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787380221.872874:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787380221.872885:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787380221.872896:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787380221.872906:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787380221.872917:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787380221.872929:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787380221.872954:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787380221.872966:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787380221.872979:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787380221.872991:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787380221.873005:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787380221.873017:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787380221.873030:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787380221.873054:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787380221.873065:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787380221.873078:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787380221.873090:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787380221.873103:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787380221.873115:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787380221.873127:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787380221.873141:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787380221.873154:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1787380221.873167:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1787380221.873179:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1787380221.873190:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1787380221.873203:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1787380221.873216:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1787380221.873228:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1787380221.873242:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1787380221.873252:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1787380221.873263:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1787380221.873275:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1787380221.873287:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1787380221.873300:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1787380221.873311:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1787380221.873322:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1787380221.873333:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1787380221.873345:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1787380221.873357:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1787380221.873369:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1787380221.873382:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1787380221.873395:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1787380221.873407:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1787380221.873580:0:9513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867386752:0@lo:502: 00000100:00100000:3.0:1787380221.873632:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380221.873665:0:9513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787380221.873751:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867386752 00000100:00100000:1.0:1787380221.873757:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867386752 00000100:00100000:1.0:1787380221.873801:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787380221.873826:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:9513:x1874203867386752:12345-0@lo:502: 00000100:00100000:1.0:1787380221.873941:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:9513:x1874203867386752:12345-0@lo:502: Request processed in 122us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380221.873949:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787380221.874133:0:9513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867386752:0@lo:502: 00000040:00080000:3.0:1787380221.874176:0:9513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1787380221.874184:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1787380221.874602:0:9529:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787380221.874615:0:9529:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9d6ffc73cd40) 00000020:00000080:1.0:1787380221.874635:0:9529:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1787380221.874779:0:9529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6fff5a3000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787380221.874784:0:9529:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6fff5a3000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787380221.874786:0:9529:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6fff5a3000 3 00010000:00080000:1.0:1787380221.874868:0:9529:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ec2625000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.130@tcp at head 00010000:00010000:1.0:1787380221.879565:0:9529:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1787380221.879667:0:9529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787380221.879721:0:9529:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787380221.879734:0:9529:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcf3c46fdcad68bd7 00000100:00080000:1.0:1787380221.879743:0:9529:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787380221.879748:0:9529:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d6ec2625000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:1.0:1787380221.880277:0:9529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff5f0b800 x1874203867386880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787380221.880318:0:9529:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787380221.880425:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867387392:0@lo:400: 00000100:00100000:1.0:1787380221.880493:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380221.880519:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867387904:0@lo:400: 00000100:00100000:1.0:1787380221.880538:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380221.880557:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787380221.880562:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867387008:0@lo:400: 00000100:00100000:1.0:1787380221.880582:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380221.880596:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867387520:0@lo:400: 00000100:00100000:1.0:1787380221.880611:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380221.880632:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867387136:0@lo:400: 00000100:00100000:1.0:1787380221.880666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380221.880693:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867387648:0@lo:400: 00000100:00100000:1.0:1787380221.880713:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380221.880731:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787380221.880737:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867387264:0@lo:400: 00000100:00100000:1.0:1787380221.880754:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380221.880762:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867387776:0@lo:400: 00000100:00100000:1.0:1787380221.880785:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380221.880835:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867387392 00000100:00100000:1.0:1787380221.880841:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867387392 00000100:00100000:1.0:1787380221.880868:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867387136 00000100:00100000:1.0:1787380221.880870:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867387136 00000100:00100000:1.0:1787380221.880882:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787380221.880888:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867387392:12345-0@lo:400: 00000100:00100000:1.0:1787380221.881065:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867387392:12345-0@lo:400: Request processed in 175us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380221.881073:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787380221.881089:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787380221.881096:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867387136:12345-0@lo:400: 00000100:00100000:1.0:1787380221.881130:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867387136:12345-0@lo:400: Request processed in 35us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380221.881136:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787380221.881158:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867387904 00000100:00100000:1.0:1787380221.881161:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867387904 00000100:00100000:1.0:1787380221.881185:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867387776 00000100:00100000:1.0:1787380221.881187:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867387776 00000100:00100000:1.0:1787380221.881202:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787380221.881208:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867387904:12345-0@lo:400: 00000100:00100000:1.0:1787380221.881234:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867387904:12345-0@lo:400: Request processed in 27us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380221.881239:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787380221.881249:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787380221.881254:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867387776:12345-0@lo:400: 00000100:00100000:1.0:1787380221.881278:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867387776:12345-0@lo:400: Request processed in 24us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380221.881284:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787380221.881299:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867387008 00000100:00100000:1.0:1787380221.881303:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867387008 00000100:00100000:1.0:1787380221.881319:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867387520 00000100:00100000:1.0:1787380221.881322:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867387520 00000100:00100000:1.0:1787380221.881333:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867387648 00000100:00100000:1.0:1787380221.881335:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867387648 00000100:00100000:1.0:1787380221.881354:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867387264 00000100:00100000:1.0:1787380221.881357:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867387264 00000100:00100000:1.0:1787380221.881369:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787380221.881374:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867387008:12345-0@lo:400: 00000100:00100000:1.0:1787380221.881402:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867387008:12345-0@lo:400: Request processed in 28us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380221.881409:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787380221.881419:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787380221.881424:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867387520:12345-0@lo:400: 00000100:00100000:1.0:1787380221.881511:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867387520:12345-0@lo:400: Request processed in 87us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380221.881518:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787380221.881529:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787380221.881534:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867387648:12345-0@lo:400: 00000100:00100000:1.0:1787380221.881557:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867387648:12345-0@lo:400: Request processed in 23us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380221.881563:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787380221.881572:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787380221.881577:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867387264:12345-0@lo:400: 00000100:00100000:1.0:1787380221.881600:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867387264:12345-0@lo:400: Request processed in 22us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380221.881606:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787380221.881634:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787380221.881638:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787380221.881641:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787380221.881673:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5f09500 x1874203867387264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380221.881707:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867387264:0@lo:400: 00010000:00080000:1.0:1787380221.881721:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5f0ad80 x1874203867387776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380221.881729:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867387776:0@lo:400: 00000100:00100000:1.0:1787380221.881738:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867387136:0@lo:400: 00010000:00080000:1.0:1787380221.881745:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5f09880 x1874203867387648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380221.881753:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867387648:0@lo:400: 00010000:00080000:1.0:1787380221.881782:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5f08e00 x1874203867387008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380221.881791:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867387008:0@lo:400: 00010000:00080000:1.0:1787380221.881798:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5f0aa00 x1874203867387520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380221.881825:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867387520:0@lo:400: 00000100:00100000:1.0:1787380221.881834:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867387392:0@lo:400: 00010000:00080000:1.0:1787380221.881842:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5f0b480 x1874203867387904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380221.881850:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867387904:0@lo:400: 00000100:00100000:3.0:1787380221.882054:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1874203867386880:0@lo:38: 00000100:00100000:3.0:1787380221.882093:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380221.882133:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867386880 00000100:00100000:3.0:1787380221.882137:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867386880 00000100:00100000:3.0:1787380221.882216:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787380221.882221:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1874203867386880:12345-0@lo:38: 00010000:00080000:3.0:1787380221.882241:0:6523:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:3.0:1787380221.882273:0:6523:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcf3c46fdcad68bde 00000004:00100000:3.0:1787380221.882287:0:6523:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787380221.882313:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9d6ec30fd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787380221.882351:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874203867386880:12345-0@lo:38: Request processed in 129us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380221.882358:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787380221.882391:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff5f0b800 x1874203867386880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787380231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380221.882399:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787380221.882406:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787380221.882413:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787380221.882418:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787380221.882421:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2625000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787380221.882426:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1874203867386880:0@lo:38: 00000020:01000004:1.0:1787380221.884923:0:9529:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00100000:3.0:1787380221.885114:0:9531:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310b480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9531:1874203867388032:0@lo:901: 00000100:00100000:3.0:1787380221.885182:0:9531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380221.885219:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867388032 00000100:00100000:3.0:1787380221.885225:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867388032 00000100:00100000:3.0:1787380221.885271:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380221.885278:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9531:x1874203867388032:12345-0@lo:901: 00000100:00100000:3.0:1787380221.885357:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9531:x1874203867388032:12345-0@lo:901: Request processed in 79us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380221.885363:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787380221.885380:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380221.885391:0:9531:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041b300 going to sleep for 11 seconds 00010000:00080000:3.0:1787380221.885411:0:9531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec310b480 x1874203867388032/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787380237 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380221.885423:0:9531:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310b480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9531:1874203867388032:0@lo:901: 00000020:00000080:1.0:1787380221.886035:0:9529:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9d6ec34f19c0) 00000020:00000080:1.0:1787380221.886057:0:9529:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:0.0:1787380221.889316:0:9529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6fff5a3000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787380221.889325:0:9529:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6fff5a3000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787380221.889328:0:9529:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6fff5a3000 3 00010000:00080000:0.0:1787380221.889362:0:9529:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ec30ea000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.130@tcp at head 00010000:00010000:0.0:1787380221.891394:0:9529:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:0.0:1787380221.891561:0:9529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1787380221.891611:0:9529:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787380221.891623:0:9529:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xcf3c46fdcad68bec 00000100:00080000:0.0:1787380221.891633:0:9529:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787380221.891639:0:9529:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9d6ec30ea000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1787380221.891673:0:9529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6fc478fb80 x1874203867388160/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787380221.891710:0:9529:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1787380221.891856:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1874203867388160:0@lo:38: 00000100:00100000:3.0:1787380221.891922:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380221.896739:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867388160 00000100:00100000:1.0:1787380221.896752:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867388160 00000100:00100000:1.0:1787380221.896795:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787380221.896804:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1874203867388160:12345-0@lo:38: 00010000:00080000:1.0:1787380221.897148:0:6522:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:1.0:1787380221.897182:0:6522:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xcf3c46fdcad68bf3 00000004:00100000:1.0:1787380221.897199:0:6522:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787380221.897230:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2756800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380221.897308:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874203867388160:12345-0@lo:38: Request processed in 504us (5385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380221.897316:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787380221.897366:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc478fb80 x1874203867388160/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787380231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380221.897376:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787380221.897383:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787380221.897389:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787380221.897394:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787380221.897396:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec30ea000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787380221.897402:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1874203867388160:0@lo:38: 00000040:00080000:1.0:1787380221.899566:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1787380221.899767:0:9513:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1787380221.899794:0:9513:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787380221.899842:0:9513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c200/0xcf3c46fdcad68bc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68bc9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.899854:0:9513:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c200/0xcf3c46fdcad68bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68bc9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787380221.899905:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787380221.899907:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787380221.899909:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787380221.899910:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787380221.899911:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787380221.899912:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787380221.899919:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787380221.899920:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787380221.899921:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787380221.899923:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787380221.899924:0:9513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787380221.899927:0:9513:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787380221.899929:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787380221.899931:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787380221.900056:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787380221.900058:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787380221.900059:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787380221.900060:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787380221.900061:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787380221.900062:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787380221.900063:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787380221.900064:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787380221.900064:0:9513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787380221.900089:0:9513:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787380221.900105:0:9513:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3108a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867388288:0@lo:253: 00000100:00100000:3.0:1787380221.900171:0:9513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380221.900203:0:9513:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956600 going to sleep for 11 seconds 00000100:00100000:1.0:1787380221.900915:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867388288 00000100:00100000:1.0:1787380221.900923:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867388288 00000100:00100000:1.0:1787380221.900988:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787380221.900998:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:9513:x1874203867388288:12345-0@lo:253: 20000000:01000000:1.0:1787380221.901024:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787380221.901038:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787380221.911180:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787380221.911195:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787380221.911454:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:9513:x1874203867388288:12345-0@lo:253: Request processed in 10453us (11278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380221.911467:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787380221.911570:0:9513:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3108a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1e31f5e-7395-4c34-a795-7159073dc2a2:9513:1874203867388288:0@lo:253: 10000000:01000000:0.0:1787380221.911583:0:9513:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787380221.911586:0:9513:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787380221.911588:0:9513:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787380221.911590:0:9513:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787380221.911591:0:9513:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787380221.911592:0:9513:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787380221.911593:0:9513:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787380221.911595:0:9513:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787380221.911596:0:9513:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787380221.911598:0:9513:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787380221.911599:0:9513:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787380221.911600:0:9513:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787380221.911616:0:9513:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1787380221.913152:0:6537:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787380221.913179:0:6537:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787380221.913203:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68bfa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.913221:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc0030400/0xcf3c46fdcad68af0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68ae9 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.913230:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad68b36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68b2f expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.913237:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68bfa lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.913276:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad68b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68b2f expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.913292:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad68b36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b2f expref: 16 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380221.913306:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ef480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874203867388416:0@lo:104: 00000100:00100000:1.0:1787380221.913354:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787380221.913404:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc0030400/0xcf3c46fdcad68af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68ae9 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.913412:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc0030400/0xcf3c46fdcad68af0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68ae9 expref: 16 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380221.913420:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34eca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874203867388544:0@lo:104: 00000100:00100000:1.0:1787380221.913448:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380221.913463:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76540 going to sleep for 11 seconds 00000100:00100000:1.0:1787380221.913480:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867388416 00000100:00100000:1.0:1787380221.913491:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867388416 00000100:00100000:1.0:1787380221.913527:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867388544 00000100:00100000:1.0:1787380221.913529:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867388544 00000100:00100000:1.0:1787380221.913541:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787380221.913547:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:6537:x1874203867388416:12345-0@lo:104: 00010000:00010000:1.0:1787380221.913558:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.913594:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787380221.913599:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:6537:x1874203867388416:12345-0@lo:104: Request processed in 53us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380221.913606:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787380221.913619:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787380221.913623:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:6537:x1874203867388544:12345-0@lo:104: 00010000:00010000:1.0:1787380221.913630:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad68ae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68af0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.913654:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787380221.913659:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:6537:x1874203867388544:12345-0@lo:104: Request processed in 36us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380221.913664:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787380221.913705:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ef480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874203867388416:0@lo:104: 00000100:00100000:1.0:1787380221.913714:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34eca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6537:1874203867388544:0@lo:104: 00010000:00010000:1.0:1787380221.913730:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68bfa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.913745:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787380221.913750:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.913762:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc0031600 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:1.0:1787380221.913766:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.913774:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380221.913781:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380221.913786:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787380221.913838:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68b2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.913845:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380221.913860:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68b2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.913867:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031600/0xcf3c46fdcad68b2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68b36 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.913877:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380221.913880:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad68ae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68af0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.913886:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89cc00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:1.0:1787380221.913888:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad68ae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68af0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.913905:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad68ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68af0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380221.913911:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad68ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68af0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380221.913917:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787380221.913929:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad68ae9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68af0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.915130:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380221.915163:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad68ae9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68af0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.915170:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad68ae9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68af0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380221.915187:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380221.915189:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380221.915191:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380221.915200:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380221.915213:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867388672:0@lo:103: 00000100:00100000:1.0:1787380221.915263:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380221.915312:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380221.915320:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867388800:0@lo:103: 00000100:00100000:1.0:1787380221.915342:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380221.915376:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867388672 00000100:00100000:1.0:1787380221.915383:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867388672 00010000:00010000:1.0:1787380221.915407:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad68b36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b2f expref: 17 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380221.917753:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867388800 00000100:00100000:1.0:1787380221.917765:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867388800 00010000:00010000:1.0:1787380221.917801:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc0030400/0xcf3c46fdcad68af0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68ae9 expref: 18 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380221.921593:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787380221.921610:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:3642:x1874203867388672:12345-0@lo:103: 00010000:00010000:3.0:1787380221.921629:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380221.921639:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad68b36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b2f expref: 18 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.921655:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad68b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b2f expref: 18 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.921672:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad68b36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68b2f expref: 18 pid: 6515 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.921696:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380221.921763:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:3642:x1874203867388672:12345-0@lo:103: Request processed in 157us (6498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380221.921777:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787380221.921796:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787380221.921802:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:3640:x1874203867388800:12345-0@lo:103: 00080000:10000000:0.0:1787380221.922037:0:9513:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1787380221.922209:0:9513:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1787380221.922414:0:9513:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1787380221.922593:0:9513:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1787380221.922854:0:9513:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1787380221.923066:0:9513:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:3.0:1787380221.925659:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380221.925689:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc0030400/0xcf3c46fdcad68af0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68ae9 expref: 16 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.925709:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc0030400/0xcf3c46fdcad68af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68ae9 expref: 16 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.925729:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc0030400/0xcf3c46fdcad68af0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68ae9 expref: 16 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.925746:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68bfa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.925755:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68bfa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787380221.925774:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012596447s 00010000:00010000:3.0:1787380221.925779:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68bfa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.925786:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68bfa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.925793:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68bfa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.925800:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68bfa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.925844:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165ac00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:3.0:1787380221.925849:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68bfa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.925857:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68bfa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.925879:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68bfa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380221.925892:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380221.926091:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:3640:x1874203867388800:12345-0@lo:103: Request processed in 4286us (10744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380221.926101:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787380221.926167:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867388672:0@lo:103: 00000100:00100000:3.0:1787380221.926199:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867388800:0@lo:103: 00010000:00010000:0.0:1787380221.926549:0:6537:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68bfa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.926558:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68bfa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380221.926564:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68bfa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1787380221.930223:0:9513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787380221.944862:0:9513:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787380221.944872:0:9513:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787380221.944908:0:9513:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787380221.945056:0:9513:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787380221.945076:0:9513:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1787380221.945095:0:9513:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1787380221.948025:0:9513:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787380221.948239:0:9513:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1787380222.029537:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787380223.023144:0:9585:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787380223.023639:0:9585:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787380223.052000:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380223.628180:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867388928:0@lo:41: 00000100:00100000:0.0:1787380223.628257:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380223.628297:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867388928 00000100:00100000:2.0:1787380223.628305:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867388928 00000100:00100000:2.0:1787380223.628360:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787380223.628368:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867388928:12345-0@lo:41: 00000004:00000024:2.0:1787380223.628399:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1787380223.628463:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867388928:12345-0@lo:41: Request processed in 95us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380223.628470:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787380223.628518:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867388928:0@lo:41: 00010000:00010000:1.0:1787380224.078257:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380224.140447:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867389184:0@lo:13: 00000100:00100000:3.0:1787380224.140505:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380224.140557:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380224.140563:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867389056:0@lo:13: 00000100:00100000:3.0:1787380224.140581:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380224.140614:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867389184 00000100:00100000:3.0:1787380224.140620:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867389184 00000100:00100000:3.0:1787380224.140655:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867389056 00000100:00100000:3.0:1787380224.140657:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867389056 00000100:00100000:3.0:1787380224.140686:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787380224.140694:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867389184:12345-0@lo:13: 00002000:00000024:3.0:1787380224.140730:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380224.140770:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867389184:12345-0@lo:13: Request processed in 77us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380224.140776:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787380224.140800:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787380224.140833:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867389056:12345-0@lo:13: 00002000:00000024:3.0:1787380224.140844:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380224.140867:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867389056:12345-0@lo:13: Request processed in 61us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380224.140873:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787380224.140890:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787380224.140916:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec20a4380 x1874203867389056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380224.140947:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867389056:0@lo:13: 00010000:00080000:3.0:1787380224.140960:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec310b100 x1874203867389184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380224.140971:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867389184:0@lo:13: 00010000:00010000:1.0:1787380225.100080:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380225.164098:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380225.164124:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867389312:0@lo:41: 00000100:00100000:2.0:1787380225.164187:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380225.164244:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867389312 00000100:00100000:2.0:1787380225.164251:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867389312 00000100:00100000:2.0:1787380225.164293:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787380225.164302:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867389312:12345-0@lo:41: 00000004:00000024:2.0:1787380225.164331:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1787380225.164374:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867389312:12345-0@lo:41: Request processed in 73us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380225.164381:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787380225.164445:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867389312:0@lo:41: 00010000:00010000:0.0:1787380226.125079:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380227.148838:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380227.213534:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867389440:0@lo:400: 00000100:00100000:1.0:1787380227.213604:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380227.213666:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867389952:0@lo:400: 00000100:00100000:1.0:1787380227.213691:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380227.213709:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867390464:0@lo:400: 00000100:00100000:1.0:1787380227.213729:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380227.213752:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787380227.213757:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867389824:0@lo:400: 00000100:00100000:1.0:1787380227.213779:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380227.213793:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867390336:0@lo:400: 00000100:00100000:1.0:1787380227.213825:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380227.213850:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867389568:0@lo:400: 00000100:00100000:1.0:1787380227.213871:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380227.213887:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867390080:0@lo:400: 00000100:00100000:1.0:1787380227.213908:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380227.213948:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867390592:0@lo:400: 00000100:00100000:1.0:1787380227.213973:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380227.213985:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787380227.213990:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867389696:0@lo:400: 00000100:00100000:1.0:1787380227.214007:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380227.214022:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1874203867390208:0@lo:400: 00000100:00100000:1.0:1787380227.214381:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380227.214401:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867390720:0@lo:400: 00000100:00100000:1.0:1787380227.214428:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380227.214451:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867389440 00000100:00100000:1.0:1787380227.214459:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867389952 00000100:00100000:2.0:1787380227.214462:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867389440 00000100:00100000:1.0:1787380227.214465:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867389952 00000100:00100000:1.0:1787380227.214507:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867389696 00000100:00100000:1.0:1787380227.214510:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867389696 00000100:00100000:2.0:1787380227.214523:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787380227.214534:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787380227.214539:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:3640:x1874203867389440:12345-0@lo:400: 00000100:00100000:1.0:1787380227.214548:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867389952:12345-0@lo:400: 00000100:00100000:1.0:1787380227.214608:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867389952:12345-0@lo:400: Request processed in 64us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380227.214616:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787380227.214621:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:3640:x1874203867389440:12345-0@lo:400: Request processed in 86us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380227.214630:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787380227.214640:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787380227.214648:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867389696:12345-0@lo:400: 00000100:00100000:1.0:1787380227.214698:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867389696:12345-0@lo:400: Request processed in 50us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380227.214704:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787380227.214725:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867390464 00000100:00100000:1.0:1787380227.214729:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867390464 00000100:00100000:1.0:1787380227.214761:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867390336 00000100:00100000:1.0:1787380227.214765:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867390336 00000100:00100000:1.0:1787380227.214784:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787380227.214802:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867390464:12345-0@lo:400: 00000100:00100000:1.0:1787380227.214865:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867390464:12345-0@lo:400: Request processed in 65us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380227.214872:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787380227.214884:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787380227.214891:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867390336:12345-0@lo:400: 00000100:00100000:2.0:1787380227.214919:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867389824 00000100:00100000:2.0:1787380227.214926:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867389824 00000100:00100000:2.0:1787380227.214950:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867389568 00000100:00100000:2.0:1787380227.214953:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867389568 00000100:00100000:2.0:1787380227.214968:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867390080 00000100:00100000:2.0:1787380227.214971:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867390080 00000100:00100000:2.0:1787380227.214987:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867390592 00000100:00100000:2.0:1787380227.214990:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867390592 00000100:00100000:2.0:1787380227.215003:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867390208 00000100:00100000:2.0:1787380227.215005:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867390208 00000100:00100000:2.0:1787380227.215018:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867390720 00000100:00100000:2.0:1787380227.215021:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867390720 00000100:00100000:2.0:1787380227.215037:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787380227.215044:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867389824:12345-0@lo:400: 00000100:00100000:1.0:1787380227.216853:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867390336:12345-0@lo:400: Request processed in 1950us (3030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380227.216870:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787380227.216987:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867389824:12345-0@lo:400: Request processed in 1939us (3202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380227.217002:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787380227.217035:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787380227.217049:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867389568:12345-0@lo:400: 00000100:00100000:2.0:1787380227.217106:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867389568:12345-0@lo:400: Request processed in 63us (3234us total) trans 0 rc 0/0 00000100:00080000:1.0:1787380227.217112:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787380227.217119:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787380227.217124:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380227.217133:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787380227.217154:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787380227.217164:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867390080:12345-0@lo:400: 00000100:00100000:2.0:1787380227.217200:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867390080:12345-0@lo:400: Request processed in 40us (3291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380227.217207:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787380227.217220:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787380227.217228:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867390592:12345-0@lo:400: 00000100:00100000:2.0:1787380227.217258:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867390592:12345-0@lo:400: Request processed in 32us (3284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380227.217265:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787380227.217280:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787380227.217288:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874203867390208:12345-0@lo:400: 00000100:00100000:2.0:1787380227.217317:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874203867390208:12345-0@lo:400: Request processed in 31us (3275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380227.217324:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787380227.217340:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787380227.217350:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874203867390720:12345-0@lo:400: 00000100:00100000:1.0:1787380227.217356:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867389696:0@lo:400: 00010000:00080000:1.0:1787380227.217375:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34ec700 x1874203867390208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380227.217388:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874203867390720:12345-0@lo:400: Request processed in 39us (2958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380227.217389:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1874203867390208:0@lo:400: 00010000:00080000:1.0:1787380227.217475:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34ed880 x1874203867390720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380227.217485:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867390720:0@lo:400: 00000100:00100000:2.0:1787380227.217487:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787380227.217499:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34efb80 x1874203867389568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380227.217508:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867389568:0@lo:400: 00010000:00080000:1.0:1787380227.217523:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34ece00 x1874203867390080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380227.217545:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867390080:0@lo:400: 00010000:00080000:1.0:1787380227.217561:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34eea00 x1874203867390592/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380227.217568:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867390592:0@lo:400: 00010000:00080000:1.0:1787380227.217617:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34edc00 x1874203867389824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380227.217627:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867389824:0@lo:400: 00010000:00080000:1.0:1787380227.217638:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34ed500 x1874203867390336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380227.217646:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867390336:0@lo:400: 00000100:00100000:1.0:1787380227.217670:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867389440:0@lo:400: 00000100:00100000:1.0:1787380227.217681:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867389952:0@lo:400: 00010000:00080000:1.0:1787380227.217691:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34ee680 x1874203867390464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380227.217699:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867390464:0@lo:400: 00010000:00010000:0.0:1787380228.176039:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787380228.238904:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787380228.238911:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6ff5cad800 from 39 10000000:01000000:3.0:1787380228.238917:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787380228.238955:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdae00/0xcf3c46fdcad68c01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.238965:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdae00/0xcf3c46fdcad68c01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.238974:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdae00/0xcf3c46fdcad68c01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380228.239000:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867390848:0@lo:101: 00000100:00100000:3.0:1787380228.239057:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380228.239095:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76540 going to sleep for 11 seconds 00000100:00100000:0.0:1787380228.239265:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867390848 00000100:00100000:0.0:1787380228.239276:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867390848 00000100:00100000:0.0:1787380228.239312:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787380228.239319:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:6518:x1874203867390848:12345-0@lo:101: 00010000:00010000:0.0:1787380228.239330:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380228.239340:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68c08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68c01 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380228.239371:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c01 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380228.239380:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c01 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380228.239388:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9ae00, rc 0) 00000100:00100000:0.0:1787380228.239426:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867390848:12345-0@lo:101: Request processed in 107us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380228.239432:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787380228.248912:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867390848:0@lo:101: 00010000:00010000:2.0:1787380228.248936:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdae00/0xcf3c46fdcad68c01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c08 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.248965:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdae00/0xcf3c46fdcad68c01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68c08 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380228.249041:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867390976:0@lo:501: 00000100:00100000:2.0:1787380228.249091:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.251235:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576840 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.251261:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867390976 00000100:00100000:2.0:1787380228.251267:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867390976 00000100:00100000:2.0:1787380228.251325:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787380228.251333:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867390976:12345-0@lo:501: 00000100:00100000:2.0:1787380228.251614:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867390976:12345-0@lo:501: Request processed in 281us (2521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.251622:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787380228.251674:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867390976:0@lo:501: 00000100:00100000:2.0:1787380228.251714:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867391104:0@lo:503: 00000100:00100000:2.0:1787380228.251753:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.251767:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576840 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.251777:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867391104 00000100:00100000:2.0:1787380228.251780:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867391104 00000100:00100000:2.0:1787380228.251798:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787380228.251803:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867391104:12345-0@lo:503: 00000100:00100000:2.0:1787380228.251879:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867391104:12345-0@lo:503: Request processed in 75us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.251885:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787380228.251915:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867391104:0@lo:503: 00000100:00100000:2.0:1787380228.252058:0:9834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9834:1874203867391232:0@lo:502: 00000100:00100000:2.0:1787380228.252086:0:9834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380228.252882:0:9834:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.255258:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867391232 00000100:00100000:2.0:1787380228.255270:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867391232 00000100:00100000:2.0:1787380228.255324:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787380228.255334:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:9834:x1874203867391232:12345-0@lo:502: 00000100:00100000:2.0:1787380228.259827:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:9834:x1874203867391232:12345-0@lo:502: Request processed in 4475us (7720us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.259840:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787380228.260015:0:9834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9834:1874203867391232:0@lo:502: 00000100:00100000:1.0:1787380228.260078:0:9834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9834:1874203867391360:0@lo:502: 00000100:00100000:1.0:1787380228.260136:0:9834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380228.260170:0:9834:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb85cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380228.269237:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867391360 00000100:00100000:3.0:1787380228.269250:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867391360 00000100:00100000:3.0:1787380228.269303:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787380228.269311:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:9834:x1874203867391360:12345-0@lo:502: 00000100:00100000:3.0:1787380228.269479:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:9834:x1874203867391360:12345-0@lo:502: Request processed in 168us (9342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380228.269486:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787380228.269674:0:9834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9834:1874203867391360:0@lo:502: 00000040:00080000:1.0:1787380228.269714:0:9834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1787380228.271736:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1787380228.271772:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787380228.271785:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdae00/0xcf3c46fdcad68c01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c08 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.271797:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdae00/0xcf3c46fdcad68c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c08 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380228.271848:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787380228.271851:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787380228.271853:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787380228.271888:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda400/0xcf3c46fdcad68c0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.271897:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda400/0xcf3c46fdcad68c0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.271905:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda400/0xcf3c46fdcad68c0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380228.271934:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867391488:0@lo:101: 00000100:00100000:3.0:1787380228.271987:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380228.272022:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76540 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.272321:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867391488 00000100:00100000:2.0:1787380228.272328:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867391488 00000100:00100000:2.0:1787380228.272371:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787380228.272379:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867391488:12345-0@lo:101: 00010000:00010000:2.0:1787380228.272390:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380228.272413:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89d400/0xcf3c46fdcad68c16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68c0f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.272435:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89d400/0xcf3c46fdcad68c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c0f expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.272458:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89d400/0xcf3c46fdcad68c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c0f expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.272466:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89d400, rc 0) 00000100:00100000:2.0:1787380228.272516:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867391488:12345-0@lo:101: Request processed in 127us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.272522:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787380228.272569:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867391488:0@lo:101: 00010000:00010000:2.0:1787380228.272589:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda400/0xcf3c46fdcad68c0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.272597:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda400/0xcf3c46fdcad68c0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380228.272663:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867391616:0@lo:501: 00000100:00100000:2.0:1787380228.272689:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.272707:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc85766c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.272719:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867391616 00000100:00100000:2.0:1787380228.272723:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867391616 00000100:00100000:2.0:1787380228.272744:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787380228.272750:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867391616:12345-0@lo:501: 00000100:00100000:2.0:1787380228.272867:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867391616:12345-0@lo:501: Request processed in 116us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.272873:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787380228.272902:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867391616:0@lo:501: 00000100:00100000:2.0:1787380228.272925:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867391744:0@lo:503: 00000100:00100000:2.0:1787380228.272960:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.272977:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc85766c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.272987:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867391744 00000100:00100000:2.0:1787380228.272990:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867391744 00000100:00100000:2.0:1787380228.273010:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787380228.273016:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867391744:12345-0@lo:503: 00000100:00100000:2.0:1787380228.273089:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867391744:12345-0@lo:503: Request processed in 71us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.273094:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787380228.273136:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867391744:0@lo:503: 00000100:00100000:1.0:1787380228.274728:0:9835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9835:1874203867391872:0@lo:502: 00000100:00100000:1.0:1787380228.274785:0:9835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380228.274860:0:9835:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb85cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.274918:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867391872 00000100:00100000:2.0:1787380228.274923:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867391872 00000100:00100000:2.0:1787380228.274955:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787380228.274964:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:9835:x1874203867391872:12345-0@lo:502: 00000100:00100000:2.0:1787380228.275102:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:9835:x1874203867391872:12345-0@lo:502: Request processed in 140us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.275109:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787380228.286761:0:9835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9835:1874203867391872:0@lo:502: 00000020:01000000:1.0:1787380228.286848:0:9835:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380228.286860:0:9835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380228.286862:0:9835:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787380228.286867:0:9835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787380228.286869:0:9835:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787380228.286900:0:9835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9835:1874203867392000:0@lo:502: 00000100:00100000:1.0:1787380228.286969:0:9835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380228.287008:0:9835:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb85cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787380228.287074:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867392000 00000100:00100000:3.0:1787380228.287081:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867392000 00000100:00100000:3.0:1787380228.287136:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787380228.287144:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:9835:x1874203867392000:12345-0@lo:502: 00000100:00100000:3.0:1787380228.287255:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:9835:x1874203867392000:12345-0@lo:502: Request processed in 111us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380228.287278:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787380228.290677:0:9835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f09500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9835:1874203867392000:0@lo:502: 00000020:01000000:1.0:1787380228.290725:0:9835:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380228.290735:0:9835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380228.290738:0:9835:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787380228.290742:0:9835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787380228.290918:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1787380228.290937:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787380228.290946:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda400/0xcf3c46fdcad68c0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.290957:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda400/0xcf3c46fdcad68c0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380228.290967:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787380228.290969:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6ff3dad800 from 39 10000000:01000000:2.0:1787380228.290972:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787380228.290999:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89de00/0xcf3c46fdcad68c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.291007:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89de00/0xcf3c46fdcad68c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.291016:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89de00/0xcf3c46fdcad68c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380228.291032:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867392128:0@lo:101: 00000100:00100000:2.0:1787380228.291095:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.291127:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb45de40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380228.291496:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867392128 00000100:00100000:3.0:1787380228.291512:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867392128 00000100:00100000:3.0:1787380228.291547:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787380228.291554:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867392128:12345-0@lo:101: 00010000:00010000:3.0:1787380228.291566:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380228.291577:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5fdb000/0xcf3c46fdcad68c24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68c1d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.291598:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5fdb000/0xcf3c46fdcad68c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c1d expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.291606:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5fdb000/0xcf3c46fdcad68c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c1d expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.291614:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fdb000, rc 0) 00000100:00100000:3.0:1787380228.291664:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867392128:12345-0@lo:101: Request processed in 110us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380228.291679:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787380228.291974:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867392128:0@lo:101: 00010000:00010000:1.0:1787380228.291988:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89de00/0xcf3c46fdcad68c1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380228.291996:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89de00/0xcf3c46fdcad68c1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380228.292047:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867392256:0@lo:501: 00000100:00100000:1.0:1787380228.292073:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380228.292099:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb85cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.292549:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867392256 00000100:00100000:2.0:1787380228.292554:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867392256 00000100:00100000:2.0:1787380228.292592:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787380228.292600:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867392256:12345-0@lo:501: 00000100:00100000:2.0:1787380228.292724:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867392256:12345-0@lo:501: Request processed in 124us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.292730:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787380228.293355:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867392256:0@lo:501: 00000100:00100000:1.0:1787380228.293390:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867392384:0@lo:503: 00000100:00100000:1.0:1787380228.293461:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380228.293485:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb85cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787380228.293706:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867392384 00000100:00100000:3.0:1787380228.293712:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867392384 00000100:00100000:3.0:1787380228.293745:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787380228.293752:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867392384:12345-0@lo:503: 00000100:00100000:3.0:1787380228.293860:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867392384:12345-0@lo:503: Request processed in 107us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380228.293866:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787380228.293917:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867392384:0@lo:503: 00000100:00100000:2.0:1787380228.295236:0:9836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9836:1874203867392512:0@lo:502: 00000100:00100000:2.0:1787380228.295300:0:9836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.295371:0:9836:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb45de40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380228.303054:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867392512 00000100:00100000:3.0:1787380228.303068:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867392512 00000100:00100000:2.0:1787380228.307367:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787380228.307382:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:9836:x1874203867392512:12345-0@lo:502: 00000100:00100000:2.0:1787380228.307729:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:9836:x1874203867392512:12345-0@lo:502: Request processed in 350us (12428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.307737:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787380228.307799:0:9836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9836:1874203867392512:0@lo:502: 00000100:00100000:2.0:1787380228.307880:0:9836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9836:1874203867392640:0@lo:502: 00000100:00100000:2.0:1787380228.307922:0:9836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.307947:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867392640 00000100:00100000:2.0:1787380228.307953:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867392640 00000100:00100000:2.0:1787380228.307978:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787380228.307984:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:9836:x1874203867392640:12345-0@lo:502: 00000100:00100000:2.0:1787380228.308045:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:9836:x1874203867392640:12345-0@lo:502: Request processed in 60us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.308057:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787380228.308096:0:9836:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576840 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.308278:0:9836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9836:1874203867392640:0@lo:502: 00000040:00080000:2.0:1787380228.308296:0:9836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1787380228.308949:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1787380228.308973:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787380228.308983:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89de00/0xcf3c46fdcad68c1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.308993:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89de00/0xcf3c46fdcad68c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380228.309002:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787380228.309004:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6ff3dad800 from 6 10000000:01000000:3.0:1787380228.309007:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787380228.309036:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbc00/0xcf3c46fdcad68c2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.309043:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbc00/0xcf3c46fdcad68c2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.309051:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbc00/0xcf3c46fdcad68c2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380228.309072:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867392768:0@lo:101: 00000100:00100000:3.0:1787380228.309120:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380228.309142:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76840 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.309277:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867392768 00000100:00100000:2.0:1787380228.309283:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867392768 00000100:00100000:2.0:1787380228.309315:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787380228.309321:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867392768:12345-0@lo:101: 00010000:00010000:2.0:1787380228.309330:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380228.309341:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89c000/0xcf3c46fdcad68c32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68c2b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.309361:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89c000/0xcf3c46fdcad68c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c2b expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.309369:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89c000/0xcf3c46fdcad68c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c2b expref: 19 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.309376:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89c000, rc 0) 00000100:00100000:2.0:1787380228.309419:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:6518:x1874203867392768:12345-0@lo:101: Request processed in 98us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.309424:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787380228.309457:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867392768:0@lo:101: 00010000:00010000:2.0:1787380228.309468:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbc00/0xcf3c46fdcad68c2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c32 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.309475:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbc00/0xcf3c46fdcad68c2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68c32 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380228.309529:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867392896:0@lo:256: 00000100:00100000:2.0:1787380228.309556:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.309567:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc85760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.309578:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867392896 00000100:00100000:2.0:1787380228.309582:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867392896 00000100:00100000:2.0:1787380228.309603:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787380228.309608:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:6518:x1874203867392896:12345-0@lo:256: 20000000:01000000:2.0:1787380228.309619:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787380228.309634:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787380228.309636:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787380228.309716:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:6518:x1874203867392896:12345-0@lo:256: Request processed in 107us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.309722:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787380228.309746:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867392896:0@lo:256: 10000000:01000000:2.0:1787380228.309778:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787380228.309783:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbc00/0xcf3c46fdcad68c2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c32 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.309790:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbc00/0xcf3c46fdcad68c2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c32 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380228.309795:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787380228.309797:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1787380228.309799:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787380228.309834:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad68c39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.309849:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad68c39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.309856:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad68c39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380228.309865:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867393024:0@lo:101: 00000100:00100000:2.0:1787380228.309890:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.309901:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4ea6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.309910:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867393024 00000100:00100000:2.0:1787380228.309913:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867393024 00000100:00100000:2.0:1787380228.309926:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787380228.309931:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:6518:x1874203867393024:12345-0@lo:101: 00010000:00010000:2.0:1787380228.309936:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380228.309943:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89c600/0xcf3c46fdcad68c40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68c39 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.309954:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89c600/0xcf3c46fdcad68c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c39 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.309961:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89c600/0xcf3c46fdcad68c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c39 expref: 20 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.309967:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89c600, rc 0) 00000100:00100000:2.0:1787380228.309988:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867393024:12345-0@lo:101: Request processed in 57us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.309993:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787380228.310014:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867393024:0@lo:101: 00010000:00010000:2.0:1787380228.310027:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad68c39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c40 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.310033:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad68c39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68c40 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380228.310070:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867393152:0@lo:501: 00000100:00100000:2.0:1787380228.310088:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.310098:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4ea6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.310107:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867393152 00000100:00100000:2.0:1787380228.310110:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867393152 00000100:00100000:2.0:1787380228.310122:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787380228.310126:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867393152:12345-0@lo:501: 00000100:00100000:2.0:1787380228.310208:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867393152:12345-0@lo:501: Request processed in 81us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.310214:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787380228.310234:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867393152:0@lo:501: 00000100:00100000:2.0:1787380228.310251:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867393280:0@lo:503: 00000100:00100000:2.0:1787380228.310279:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.310289:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4ea6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.310297:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867393280 00000100:00100000:2.0:1787380228.310300:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867393280 00000100:00100000:2.0:1787380228.310313:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787380228.310317:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867393280:12345-0@lo:503: 00000100:00100000:2.0:1787380228.310377:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867393280:12345-0@lo:503: Request processed in 58us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.310382:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787380228.310415:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867393280:0@lo:503: 00000100:00100000:2.0:1787380228.310555:0:9837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9837:1874203867393408:0@lo:502: 00000100:00100000:2.0:1787380228.310582:0:9837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.310596:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867393408 00000100:00100000:2.0:1787380228.310598:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867393408 00000100:00100000:2.0:1787380228.310612:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787380228.310616:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:9837:x1874203867393408:12345-0@lo:502: 00000100:00100000:2.0:1787380228.310687:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:9837:x1874203867393408:12345-0@lo:502: Request processed in 70us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.310693:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787380228.310715:0:9837:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4ea6540 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.310724:0:9837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9837:1874203867393408:0@lo:502: 00000020:01000000:2.0:1787380228.310741:0:9837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787380228.310746:0:9837:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787380228.310752:0:9837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380228.310753:0:9837:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787380228.310757:0:9837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787380228.310760:0:9837:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.130@tcp to nid 0x20000c0a8ce82 (192.168.206.130@tcp) 00000020:01000000:2.0:1787380228.310776:0:9837:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787380228.310778:0:9837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787380228.310790:0:9837:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9d6ff4c63380) 00000020:00000080:2.0:1787380228.310826:0:9837:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1787380228.310831:0:9837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787380228.310893:0:9837:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787380228.310899:0:9837:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787380228.310904:0:9837:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf3c46fdcad68c4e 00010000:00080000:2.0:1787380228.310926:0:9837:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ec3396000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.130@tcp at head 00010000:00010000:2.0:1787380228.311111:0:9837:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1787380228.311212:0:9837:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787380228.311221:0:9837:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787380228.311345:0:9837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787380228.311440:0:9837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787380228.311571:0:9837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787380228.311666:0:9837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787380228.315140:0:9838:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787380228.315148:0:9838:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787380228.318759:0:9837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787380228.318772:0:9837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787380228.318835:0:9837:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787380228.318857:0:9837:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3c46fdcad68c55 00000100:00080000:3.0:1787380228.318866:0:9837:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787380228.318872:0:9837:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d6ec3396000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1787380228.318903:0:9837:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3109c00 x1874203867393536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787380228.318926:0:9837:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787380228.318984:0:9837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380228.318987:0:9837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380228.318989:0:9837:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787380228.318991:0:9837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380228.318994:0:9837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380228.318995:0:9837:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787380228.318998:0:9837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787380228.318999:0:9837:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787380228.319021:0:9837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9837:1874203867393664:0@lo:502: 00000100:00100000:3.0:1787380228.319090:0:9837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380228.319130:0:9837:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787380228.319263:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867393536:0@lo:8: 00000100:00100000:1.0:1787380228.319296:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380228.319335:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867393536 00000100:00100000:1.0:1787380228.319340:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867393536 00000100:00100000:1.0:1787380228.319365:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787380228.319371:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1874203867393536:12345-0@lo:8: 00010000:00080000:1.0:1787380228.319393:0:8436:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1787380228.319424:0:8436:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3c46fdcad68c5c 00002000:00100000:1.0:1787380228.319435:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9d6ec2755000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113674 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1787380228.319438:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1787380228.319441:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787380228.319492:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787380228.319976:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1787380228.319996:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2752800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380228.320038:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3638:x1874203867393536:12345-0@lo:8: Request processed in 665us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380228.320044:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787380228.320299:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3109c00 x1874203867393536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787380238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380228.320308:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787380228.320315:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1787380228.320329:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787380228.320333:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787380228.320336:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3396000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787380228.320353:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787380228.320359:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867393536:0@lo:8: 00000100:00100000:2.0:1787380228.320899:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867393664 00000100:00100000:2.0:1787380228.320905:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867393664 00000100:00100000:2.0:1787380228.320938:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787380228.320945:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:9837:x1874203867393664:12345-0@lo:502: 00000100:00100000:2.0:1787380228.321057:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:9837:x1874203867393664:12345-0@lo:502: Request processed in 112us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.321064:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787380228.321116:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867393920:0@lo:400: 00000100:00100000:2.0:1787380228.321145:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.321169:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867394432:0@lo:400: 00000100:00100000:2.0:1787380228.321190:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.321206:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1874203867394944:0@lo:400: 00000100:00100000:2.0:1787380228.321225:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.321241:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787380228.321247:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867393792:0@lo:400: 00000100:00100000:2.0:1787380228.321265:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.321279:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1874203867394304:0@lo:400: 00000100:00100000:2.0:1787380228.321299:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.321308:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1874203867394816:0@lo:400: 00000100:00100000:2.0:1787380228.321326:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.321344:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867394048:0@lo:400: 00000100:00100000:2.0:1787380228.321376:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.321386:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867394560:0@lo:400: 00000100:00100000:2.0:1787380228.321595:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.321617:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787380228.321624:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867394176:0@lo:400: 00000100:00100000:2.0:1787380228.321658:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.321676:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867394688:0@lo:400: 00000100:00100000:2.0:1787380228.321695:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.321751:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867393920 00000100:00100000:2.0:1787380228.321755:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867393920 00000100:00100000:2.0:1787380228.321776:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867394176 00000100:00100000:2.0:1787380228.321780:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867394176 00000100:00100000:2.0:1787380228.321795:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787380228.321801:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867393920:12345-0@lo:400: 00000100:00100000:2.0:1787380228.321866:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867393920:12345-0@lo:400: Request processed in 64us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.321873:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787380228.321885:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787380228.321892:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867394176:12345-0@lo:400: 00000100:00100000:2.0:1787380228.321924:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867394176:12345-0@lo:400: Request processed in 33us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.321930:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787380228.321946:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867394432 00000100:00100000:2.0:1787380228.321949:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867394432 00000100:00100000:2.0:1787380228.321967:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867394944 00000100:00100000:2.0:1787380228.321969:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867394944 00000100:00100000:2.0:1787380228.321979:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867393792 00000100:00100000:2.0:1787380228.321982:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867393792 00000100:00100000:2.0:1787380228.322004:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867394304 00000100:00100000:2.0:1787380228.322008:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867394304 00000100:00100000:2.0:1787380228.322021:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867394816 00000100:00100000:2.0:1787380228.322024:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867394816 00000100:00100000:2.0:1787380228.322034:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867394048 00000100:00100000:2.0:1787380228.322036:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867394048 00000100:00100000:2.0:1787380228.322047:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787380228.322053:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867394432:12345-0@lo:400: 00000100:00100000:2.0:1787380228.322086:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867394432:12345-0@lo:400: Request processed in 33us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.322092:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000004:00080000:1.0:1787380228.322543:0:9838:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787380228.322604:0:9838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 238646794499ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787380228.322611:0:9838:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787380228.322726:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787380228.322734:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874203867394944:12345-0@lo:400: 00000100:00100000:2.0:1787380228.322773:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874203867394944:12345-0@lo:400: Request processed in 39us (1546us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.322779:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787380228.322791:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787380228.322797:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867393792:12345-0@lo:400: 00000100:00100000:2.0:1787380228.322882:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867393792:12345-0@lo:400: Request processed in 84us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.322888:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787380228.322900:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787380228.322905:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874203867394304:12345-0@lo:400: 00000100:00100000:2.0:1787380228.322947:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874203867394304:12345-0@lo:400: Request processed in 41us (1646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.322955:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787380228.322968:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787380228.322974:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874203867394816:12345-0@lo:400: 00000100:00100000:2.0:1787380228.323010:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874203867394816:12345-0@lo:400: Request processed in 37us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.323016:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787380228.323029:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787380228.323036:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867394048:12345-0@lo:400: 00000100:00100000:2.0:1787380228.323061:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867394048:12345-0@lo:400: Request processed in 26us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.323067:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787380228.323094:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867394560 00000100:00100000:3.0:1787380228.323538:0:9837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9837:1874203867393664:0@lo:502: 00000020:01000000:3.0:1787380228.323574:0:9837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380228.323582:0:9837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380228.323585:0:9837:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787380228.323589:0:9837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:2.0:1787380228.324041:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867394560 00000100:00100000:2.0:1787380228.324077:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867394688 00000100:00100000:2.0:1787380228.324081:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867394688 00000100:00100000:2.0:1787380228.324119:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787380228.324127:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867394560:12345-0@lo:400: 00000100:00100000:2.0:1787380228.324170:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867394560:12345-0@lo:400: Request processed in 44us (2574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.324175:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787380228.324187:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787380228.324192:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867394688:12345-0@lo:400: 00000100:00100000:2.0:1787380228.324220:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867394688:12345-0@lo:400: Request processed in 29us (2524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.324226:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000000:2.0:1787380228.324788:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 00010000:00080000:3.0:1787380228.324901:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec20a7b80 x1874203867393792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380228.324914:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867393792:0@lo:400: 00010000:00080000:3.0:1787380228.324928:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec20a6300 x1874203867394304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380228.324935:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1874203867394304:0@lo:400: 00010000:00080000:3.0:1787380228.324946:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec361c700 x1874203867394816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380228.324954:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1874203867394816:0@lo:400: 00000100:00100000:3.0:1787380228.324964:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867393920:0@lo:400: 00010000:00080000:3.0:1787380228.324974:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec20a4380 x1874203867394432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380228.324981:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867394432:0@lo:400: 00010000:00080000:3.0:1787380228.324991:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec361d500 x1874203867394944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380228.325009:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1874203867394944:0@lo:400: 00000100:00100000:3.0:1787380228.325069:0:9839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9839:1874203867395072:0@lo:700: 00000100:00100000:3.0:1787380228.325106:0:9839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380228.325128:0:9839:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76b40 going to sleep for 11 seconds 10000000:01000000:2.0:1787380228.325254:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787380228.325265:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad68c39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c40 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.325287:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad68c39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c40 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380228.325297:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787380228.325299:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6fc873b000 from 39 10000000:01000000:2.0:1787380228.325302:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787380228.325326:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68c63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.325334:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68c63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.325342:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68c63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380228.325355:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867395200:0@lo:101: 00000100:00100000:2.0:1787380228.325386:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.325418:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb45d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.325437:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867395072 00000100:00100000:2.0:1787380228.325442:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867395072 00000100:00100000:2.0:1787380228.325480:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787380228.325487:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9839:x1874203867395072:12345-0@lo:700: 00000100:00100000:2.0:1787380228.325979:0:8443:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8443:1874203867395328:0@lo:700: 00000100:00100000:2.0:1787380228.326008:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.326031:0:8443:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc9560c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.326056:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867395200 00000100:00100000:2.0:1787380228.326059:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867395200 00000100:00100000:2.0:1787380228.326086:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787380228.331043:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867395200:12345-0@lo:101: 00010000:00010000:2.0:1787380228.331064:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380228.331089:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68c6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68c63 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.331120:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c63 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.331131:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c63 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380228.331381:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867395328 00000100:00100000:3.0:1787380228.331389:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867395328 00000100:00100000:3.0:1787380228.331446:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380228.331455:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8443:x1874203867395328:12345-0@lo:700: 00010000:00010000:2.0:1787380228.331855:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89d800, rc 0) 00000100:00100000:2.0:1787380228.331933:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867395200:12345-0@lo:101: Request processed in 5833us (6545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.331940:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:2.0:1787380228.331977:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787380228.332029:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867394176:0@lo:400: 00010000:00080000:2.0:1787380228.332045:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff3ff9180 x1874203867394688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380228.332054:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867394688:0@lo:400: 00010000:00080000:2.0:1787380228.332066:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec20a5880 x1874203867394048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380228.332074:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867394048:0@lo:400: 00010000:00080000:2.0:1787380228.332085:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff3ff8000 x1874203867394560/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380244 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380228.332092:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867394560:0@lo:400: 00000100:00100000:3.0:1787380228.332473:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867395200:0@lo:101: 00010000:00010000:3.0:1787380228.332489:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68c63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.332500:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68c63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68c6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380228.332582:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3108e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867395456:0@lo:501: 00000100:00100000:3.0:1787380228.332620:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380228.332662:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76840 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.332854:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867395456 00000100:00100000:2.0:1787380228.332859:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867395456 00000100:00100000:2.0:1787380228.332890:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787380228.332897:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867395456:12345-0@lo:501: 00000100:00100000:2.0:1787380228.333008:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867395456:12345-0@lo:501: Request processed in 111us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.333015:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787380228.333048:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3108e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867395456:0@lo:501: 00000100:00100000:2.0:1787380228.333074:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867395584:0@lo:503: 00000100:00100000:2.0:1787380228.333135:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.333148:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956480 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.333161:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867395584 00000100:00100000:2.0:1787380228.333164:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867395584 00000100:00100000:2.0:1787380228.333183:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787380228.333190:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867395584:12345-0@lo:503: 00000100:00100000:2.0:1787380228.333260:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867395584:12345-0@lo:503: Request processed in 70us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.333266:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787380228.333304:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867395584:0@lo:503: 00000004:00080000:3.0:1787380228.333977:0:7453:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:3.0:1787380228.334304:0:9840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3108700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9840:1874203867395712:0@lo:502: 00000100:00100000:3.0:1787380228.334349:0:9840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380228.334377:0:9840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76840 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.334424:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867395712 00000100:00100000:2.0:1787380228.334430:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867395712 00000100:00100000:2.0:1787380228.334464:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787380228.334471:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:9840:x1874203867395712:12345-0@lo:502: 00000100:00100000:2.0:1787380228.334713:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:9840:x1874203867395712:12345-0@lo:502: Request processed in 242us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.334732:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787380228.334801:0:9840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3108700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9840:1874203867395712:0@lo:502: 00000100:00100000:3.0:1787380228.334871:0:9840:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3108700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9840:1874203867395840:0@lo:502: 00000100:00100000:3.0:1787380228.334909:0:9840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380228.334929:0:9840:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb45d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.334997:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867395840 00000100:00100000:2.0:1787380228.335003:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867395840 00000100:00100000:2.0:1787380228.335034:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787380228.335041:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:9840:x1874203867395840:12345-0@lo:502: 00000100:00100000:2.0:1787380228.336252:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:9840:x1874203867395840:12345-0@lo:502: Request processed in 1207us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.336263:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787380228.336346:0:9840:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3108700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9840:1874203867395840:0@lo:502: 00000040:00080000:2.0:1787380228.336374:0:9840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1787380228.336454:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1787380228.336473:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787380228.336483:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68c63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.336493:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380228.338207:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787380228.338215:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6fc873b000 from 6 10000000:01000000:2.0:1787380228.338219:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787380228.338254:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68c71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.338264:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68c71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.338273:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68c71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380228.338298:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867395968:0@lo:101: 00000100:00100000:2.0:1787380228.338350:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.338382:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.338414:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867395968 00000100:00100000:2.0:1787380228.338420:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867395968 00000100:00100000:2.0:1787380228.338461:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787380228.338470:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867395968:12345-0@lo:101: 00010000:00010000:2.0:1787380228.338482:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380228.338493:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89d600/0xcf3c46fdcad68c78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68c71 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.340334:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89d600/0xcf3c46fdcad68c78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c71 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.340350:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89d600/0xcf3c46fdcad68c78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c71 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.340360:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89d600, rc 0) 00000100:00100000:2.0:1787380228.340421:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867395968:12345-0@lo:101: Request processed in 1951us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.340429:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787380228.340488:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867395968:0@lo:101: 00010000:00010000:2.0:1787380228.341734:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68c71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.341751:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68c71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68c78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380228.341841:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867396096:0@lo:256: 00000100:00100000:2.0:1787380228.341889:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.341919:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.341935:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867396096 00000100:00100000:2.0:1787380228.341940:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867396096 00000100:00100000:2.0:1787380228.341978:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787380228.341987:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867396096:12345-0@lo:256: 20000000:01000000:2.0:1787380228.342004:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787380228.342020:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787380228.342023:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1787380228.342117:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867396096:12345-0@lo:256: Request processed in 112us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.342125:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787380228.342164:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867396096:0@lo:256: 10000000:01000000:2.0:1787380228.342204:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787380228.342212:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68c71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.342220:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68c71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380228.342229:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787380228.342231:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1787380228.342234:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787380228.342255:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.342270:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.342279:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380228.342292:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867396224:0@lo:101: 00000100:00100000:2.0:1787380228.342317:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.342331:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.342343:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867396224 00000100:00100000:2.0:1787380228.342347:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867396224 00000100:00100000:2.0:1787380228.342368:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787380228.342374:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867396224:12345-0@lo:101: 00010000:00010000:2.0:1787380228.342382:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380228.342392:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89cc00/0xcf3c46fdcad68c86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68c7f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.342423:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89cc00/0xcf3c46fdcad68c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c7f expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.342430:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89cc00/0xcf3c46fdcad68c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c7f expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.342437:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89cc00, rc 0) 00000100:00100000:2.0:1787380228.342465:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867396224:12345-0@lo:101: Request processed in 91us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.342471:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1787380228.342500:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867396224:0@lo:101: 00010000:00010000:2.0:1787380228.342529:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68c7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380228.342536:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68c7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68c86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380228.342582:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867396352:0@lo:501: 00000100:00100000:2.0:1787380228.342604:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.342615:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.342624:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867396352 00000100:00100000:2.0:1787380228.342627:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867396352 00000100:00100000:2.0:1787380228.342653:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787380228.342659:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867396352:12345-0@lo:501: 00000100:00100000:2.0:1787380228.342750:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867396352:12345-0@lo:501: Request processed in 90us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.342755:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787380228.342779:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867396352:0@lo:501: 00000100:00100000:2.0:1787380228.342799:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867396480:0@lo:503: 00000100:00100000:2.0:1787380228.342857:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.342870:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.342880:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867396480 00000100:00100000:2.0:1787380228.342883:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867396480 00000100:00100000:2.0:1787380228.342900:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787380228.342906:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867396480:12345-0@lo:503: 00000100:00100000:2.0:1787380228.342971:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867396480:12345-0@lo:503: Request processed in 65us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.342977:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1787380228.343017:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867396480:0@lo:503: 00000100:00100000:2.0:1787380228.347879:0:9841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9841:1874203867396608:0@lo:502: 00000100:00100000:2.0:1787380228.347958:0:9841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.347994:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867396608 00000100:00100000:2.0:1787380228.348000:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867396608 00000100:00100000:2.0:1787380228.348041:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787380228.348049:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:9841:x1874203867396608:12345-0@lo:502: 00000100:00100000:2.0:1787380228.348349:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:9841:x1874203867396608:12345-0@lo:502: Request processed in 299us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.348357:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787380228.348462:0:9841:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956600 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.348484:0:9841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9841:1874203867396608:0@lo:502: 00000020:01000000:2.0:1787380228.348579:0:9841:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787380228.348586:0:9841:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787380228.348592:0:9841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380228.348594:0:9841:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787380228.348600:0:9841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787380228.348604:0:9841:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.130@tcp to nid 0x20000c0a8ce82 (192.168.206.130@tcp) 00000020:01000000:2.0:1787380228.348623:0:9841:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787380228.348625:0:9841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787380228.348638:0:9841:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9d6ff4c60000) 00000020:00000080:2.0:1787380228.348673:0:9841:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1787380228.348679:0:9841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787380228.348761:0:9841:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787380228.348766:0:9841:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:2.0:1787380228.348772:0:9841:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3c46fdcad68c94 00010000:00080000:2.0:1787380228.348801:0:9841:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ec3769800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.130@tcp at head 00010000:00010000:2.0:1787380228.349031:0:9841:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:2.0:1787380228.356337:0:9841:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787380228.356356:0:9841:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787380228.356702:0:9841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787380228.356828:0:9841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787380228.356955:0:9841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787380228.357026:0:9841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1787380228.362071:0:9842:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787380228.362077:0:9842:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 40000000:02000000:2.0:1787380228.362237:0:6528:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000020:00000080:0.0:1787380228.368663:0:9841:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787380228.368678:0:9841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787380228.368724:0:9841:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787380228.368749:0:9841:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3c46fdcad68c9b 00000100:00080000:0.0:1787380228.368758:0:9841:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787380228.368764:0:9841:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d6ec3769800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1787380228.368797:0:9841:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6fc478ca80 x1874203867396736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787380228.368834:0:9841:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787380228.368892:0:9841:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380228.368896:0:9841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380228.368898:0:9841:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787380228.368907:0:9841:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380228.368912:0:9841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380228.368913:0:9841:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787380228.368916:0:9841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787380228.368918:0:9841:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787380228.368943:0:9841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9841:1874203867396864:0@lo:502: 00000100:00100000:0.0:1787380228.369013:0:9841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380228.369047:0:9841:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380228.371824:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867396736:0@lo:8: 00000100:00100000:3.0:1787380228.371900:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380228.372974:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867396864 00000100:00100000:3.0:1787380228.372984:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867396864 00000100:00100000:3.0:1787380228.373033:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787380228.373041:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:9841:x1874203867396864:12345-0@lo:502: 00000100:00100000:3.0:1787380228.373201:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:9841:x1874203867396864:12345-0@lo:502: Request processed in 160us (4187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380228.373209:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787380228.374307:0:9841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:9841:1874203867396864:0@lo:502: 00000020:01000000:0.0:1787380228.374342:0:9841:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380228.374350:0:9841:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380228.374352:0:9841:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787380228.374356:0:9841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:0.0:1787380228.376537:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867396736 00000100:00100000:0.0:1787380228.376548:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867396736 00000100:00100000:0.0:1787380228.376588:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787380228.376596:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3638:x1874203867396736:12345-0@lo:8: 00010000:00080000:0.0:1787380228.376629:0:8433:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:0.0:1787380228.376671:0:8433:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3c46fdcad68ca2 00002000:00100000:0.0:1787380228.376687:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9d6ec36c1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113674 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787380228.376691:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787380228.376694:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787380228.376762:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787380228.376785:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9d6ec36c5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787380228.376884:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1874203867396736:12345-0@lo:8: Request processed in 287us (4983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380228.376892:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787380228.376943:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc478ca80 x1874203867396736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787380238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380228.376960:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787380228.376968:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787380228.376975:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787380228.376980:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787380228.376982:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3769800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787380228.376995:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787380228.377001:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867396736:0@lo:8: 00000004:00080000:0.0:1787380228.377032:0:9842:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787380228.377077:0:9842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 238701267556ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787380228.377083:0:9842:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:3.0:1787380228.378337:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1787380228.378370:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787380228.378380:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68c7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.378392:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380228.378401:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787380228.378404:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9d6ff8828000 from 1 10000000:01000000:3.0:1787380228.378406:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787380228.378439:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68ca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.378448:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68ca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.378457:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68ca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380228.378486:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867396992:0@lo:101: 00000100:00100000:3.0:1787380228.378549:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380228.378581:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4ea6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380228.379242:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867396992 00000100:00100000:3.0:1787380228.379250:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867396992 00000100:00100000:3.0:1787380228.379287:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787380228.379293:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867396992:12345-0@lo:101: 00010000:00010000:3.0:1787380228.379303:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380228.379314:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5fdb200/0xcf3c46fdcad68cb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68ca9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.379335:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5fdb200/0xcf3c46fdcad68cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68ca9 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.379344:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5fdb200/0xcf3c46fdcad68cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68ca9 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.379351:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fdb200, rc 0) 00000100:00100000:3.0:1787380228.379385:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:6518:x1874203867396992:12345-0@lo:101: Request processed in 92us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380228.379391:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787380228.379439:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867396992:0@lo:101: 00010000:00010000:3.0:1787380228.379450:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68ca9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68cb0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.379458:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68ca9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68cb0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380228.379529:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867397120:0@lo:501: 00000100:00100000:3.0:1787380228.379552:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380228.379568:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76840 going to sleep for 11 seconds 00000100:00100000:3.0:1787380228.379576:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867397120 00000100:00100000:3.0:1787380228.379579:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867397120 00000100:00100000:3.0:1787380228.379596:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787380228.379600:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:6518:x1874203867397120:12345-0@lo:501: 00000100:00100000:3.0:1787380228.379671:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:6518:x1874203867397120:12345-0@lo:501: Request processed in 70us (118us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787380228.379678:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787380228.379710:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867397120:0@lo:501: 10000000:01000000:3.0:1787380228.379730:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787380228.379735:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68ca9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68cb0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380228.379742:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68cb0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380228.383798:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8443:x1874203867395328:12345-0@lo:700: Request processed in 52337us (57783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.383843:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:00080000:0.0:1787380228.389617:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787380228.391376:0:9843:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787380228.391405:0:9843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9843:1874203867397376:0@lo:7: 00000100:00100000:0.0:1787380228.391464:0:9843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380228.391493:0:9843:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787380228.391530:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380228.391541:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867397248:0@lo:13: 00000100:00100000:0.0:1787380228.391568:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380228.391606:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867397376 00000100:00100000:0.0:1787380228.391613:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867397376 00000100:00100000:0.0:1787380228.391675:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787380228.391684:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9843:x1874203867397376:12345-0@lo:7: 00010000:00080000:3.0:1787380228.392642:0:8443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec361fb80 x1874203867395328/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787380244 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380228.392668:0:8443:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8443:1874203867395328:0@lo:700: 40000000:02000000:3.0:1787380228.392680:0:8443:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00080000:2.0:1787380228.402729:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787380228.402854:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867397248 00000100:00100000:2.0:1787380228.402864:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867397248 00000100:00100000:2.0:1787380228.402918:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787380228.402927:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1874203867397248:12345-0@lo:13: 00002000:00000024:2.0:1787380228.402959:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923869696 avail 3692347392 00000100:00100000:2.0:1787380228.403037:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3642:x1874203867397248:12345-0@lo:13: Request processed in 110us (11467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.403044:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787380228.403091:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc478ca80 x1874203867397248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380228.403589:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867397248:0@lo:13: 00002000:00080000:0.0:1787380228.414088:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787380228.414096:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787380228.414345:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9843:x1874203867397376:12345-0@lo:7: Request processed in 22658us (22876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380228.414356:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787380228.414883:0:9843:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc478e300 x1874203867397376/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787380244 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380228.414911:0:9843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9843:1874203867397376:0@lo:7: 00000004:00080000:3.0:1787380228.414924:0:9843:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787380228.414959:0:9843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9843:1874203867397504:0@lo:5: 00000100:00100000:3.0:1787380228.414996:0:9843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380228.415028:0:9843:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76840 going to sleep for 11 seconds 00000100:00100000:0.0:1787380228.415240:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867397504 00000100:00100000:0.0:1787380228.415246:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867397504 00000100:00100000:0.0:1787380228.415280:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787380228.415288:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9843:x1874203867397504:12345-0@lo:5: 00002000:00080000:0.0:1787380228.415311:0:8433:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787380228.415314:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1787380228.426464:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1787380228.426484:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787380228.426489:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1787380228.426604:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9839:x1874203867395072:12345-0@lo:700: Request processed in 101114us (101493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380228.426620:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787380228.426681:0:9839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec310b800 x1874203867395072/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787380244 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380228.426695:0:9839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9839:1874203867395072:0@lo:700: 00000100:00100000:0.0:1787380228.427183:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9843:x1874203867397504:12345-0@lo:5: Request processed in 11894us (12185us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787380228.427192:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787380228.430203:0:9843:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec310a680 x1874203867397504/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787380244 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380228.430218:0:9843:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787380228.430225:0:9843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9843:1874203867397504:0@lo:5: 00000004:00080000:3.0:1787380228.430240:0:9843:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787380228.430287:0:9843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9843:1874203867397632:0@lo:700: 00000100:00100000:3.0:1787380228.430333:0:9843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380228.430368:0:9843:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76840 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.430698:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867397632 00000100:00100000:2.0:1787380228.430706:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867397632 00000100:00100000:2.0:1787380228.430760:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787380228.430767:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec310b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9843:x1874203867397632:12345-0@lo:700: 00000100:00100000:3.0:1787380228.441640:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867397760:0@lo:13: 00000100:00100000:3.0:1787380228.441725:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787380228.442535:0:9839:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787380228.442563:0:9839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9839:1874203867397888:0@lo:7: 00000100:00100000:2.0:1787380228.442608:0:9839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.442633:0:9839:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956900 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.442664:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867397760 00000100:00100000:2.0:1787380228.442670:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867397760 00000100:00100000:2.0:1787380228.442713:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787380228.442721:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867397760:12345-0@lo:13: 00002000:00000024:2.0:1787380228.442739:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923869696 avail 3692347392 00000100:00100000:2.0:1787380228.445271:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867397760:12345-0@lo:13: Request processed in 2542us (3537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.445285:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787380228.445328:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867397888 00000100:00100000:2.0:1787380228.445335:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867397888 00000100:00100000:2.0:1787380228.445377:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787380228.445385:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9839:x1874203867397888:12345-0@lo:7: 00010000:00080000:3.0:1787380228.449538:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec361dc00 x1874203867397760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380228.449562:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867397760:0@lo:13: 00000100:00100000:3.0:1787380228.455686:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec310b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9843:x1874203867397632:12345-0@lo:700: Request processed in 24912us (25345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380228.455699:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787380228.455756:0:9843:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec310a680 x1874203867397632/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787380244 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380228.455771:0:9843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9843:1874203867397632:0@lo:700: 00000004:02000040:3.0:1787380228.461895:0:9843:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00002000:00080000:2.0:1787380228.467389:0:8871:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1787380228.467917:0:8871:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787380228.468004:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9839:x1874203867397888:12345-0@lo:7: Request processed in 22616us (25391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.468014:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787380228.468070:0:9839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec361f800 x1874203867397888/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787380244 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380228.468085:0:9839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9839:1874203867397888:0@lo:7: 00000004:00080000:2.0:1787380228.468097:0:9839:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787380228.468132:0:9839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9839:1874203867398016:0@lo:5: 00000100:00100000:2.0:1787380228.468165:0:9839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.468199:0:9839:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956900 going to sleep for 11 seconds 00000100:00100000:2.0:1787380228.468215:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867398016 00000100:00100000:2.0:1787380228.468230:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867398016 00000100:00100000:2.0:1787380228.468311:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787380228.468320:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9839:x1874203867398016:12345-0@lo:5: 00002000:00080000:2.0:1787380228.468345:0:8435:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1787380228.468374:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9839:x1874203867398016:12345-0@lo:5: Request processed in 56us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.468381:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787380228.470044:0:9843:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9843:1874203867398144:0@lo:5: 00000100:00100000:0.0:1787380228.470092:0:9843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380228.470128:0:9843:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5000 going to sleep for 11 seconds 00000100:00100000:3.0:1787380228.470418:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867398144 00000100:00100000:3.0:1787380228.470425:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867398144 00000100:00100000:3.0:1787380228.470463:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787380228.470471:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9843:x1874203867398144:12345-0@lo:5: 00010000:00080000:2.0:1787380228.475343:0:9839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec361f800 x1874203867398016/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787380244 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380228.475360:0:9839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9839:1874203867398016:0@lo:5: 00000004:00080000:2.0:1787380228.475372:0:9839:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787380228.475418:0:9839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9839:1874203867398272:0@lo:5: 00000100:00100000:2.0:1787380228.475481:0:9839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380228.476054:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867398272 00000100:00100000:1.0:1787380228.476061:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867398272 00000100:00100000:1.0:1787380228.476106:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787380228.476115:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9839:x1874203867398272:12345-0@lo:5: 00002000:00080000:1.0:1787380228.476150:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1787380228.476605:0:9839:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956900 going to sleep for 11 seconds 00002000:00080000:3.0:1787380228.479163:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1787380228.479181:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1787380228.480265:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9839:x1874203867398272:12345-0@lo:5: Request processed in 4146us (4777us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787380228.480278:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787380228.481180:0:9839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec361f800 x1874203867398272/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787380244 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380228.481213:0:9839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9839:1874203867398272:0@lo:5: 00000004:00080000:2.0:1787380228.481228:0:9839:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787380228.481269:0:9839:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9839:1874203867398400:0@lo:900: 00000100:00100000:2.0:1787380228.481309:0:9839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.481337:0:9839:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956900 going to sleep for 11 seconds 00000100:00100000:3.0:1787380228.482237:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867398400 00000100:00100000:3.0:1787380228.482246:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867398400 00000100:00100000:3.0:1787380228.482294:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380228.482303:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9839:x1874203867398400:12345-0@lo:900: 00000100:00100000:3.0:1787380228.482362:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9839:x1874203867398400:12345-0@lo:900: Request processed in 60us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380228.482369:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380228.483789:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9843:x1874203867398144:12345-0@lo:5: Request processed in 13316us (13693us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787380228.483827:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787380228.484177:0:9839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec361df80 x1874203867398400/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787380244 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380228.484190:0:9839:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9839:1874203867398400:0@lo:900: 00010000:00080000:1.0:1787380228.484317:0:9843:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc478e300 x1874203867398144/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787380244 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380228.484330:0:9843:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9843:1874203867398144:0@lo:5: 00000004:00080000:1.0:1787380228.484341:0:9843:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:2.0:1787380228.752024:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867398528:0@lo:41: 00000100:00100000:2.0:1787380228.752108:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380228.755879:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867398528 00000100:00100000:2.0:1787380228.755892:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867398528 00000100:00100000:2.0:1787380228.755943:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787380228.755952:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867398528:12345-0@lo:41: 00000004:00000024:2.0:1787380228.755986:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787380228.756073:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867398528:12345-0@lo:41: Request processed in 122us (3965us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380228.756080:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787380228.756137:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867398528:0@lo:41: 00000001:02000400:0.0:1787380228.804794:0:9885:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787380229.203983:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380229.259917:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380229.259939:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867398656:0@lo:13: 00000100:00100000:3.0:1787380229.259993:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380229.260055:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867398656 00000100:00100000:3.0:1787380229.260062:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867398656 00000100:00100000:3.0:1787380229.260113:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787380229.260121:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867398656:12345-0@lo:13: 00002000:00000024:3.0:1787380229.260145:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380229.260178:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867398656:12345-0@lo:13: Request processed in 59us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380229.260184:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787380229.260207:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787380229.260234:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec310a680 x1874203867398656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380229.260249:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867398656:0@lo:13: 00000100:00100000:0.0:1787380229.262418:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867398784:0@lo:13: 00000100:00100000:0.0:1787380229.262475:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380229.262566:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867398784 00000100:00100000:2.0:1787380229.262573:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867398784 00000100:00100000:2.0:1787380229.262621:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787380229.262628:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867398784:12345-0@lo:13: 00002000:00000024:2.0:1787380229.262657:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380229.262695:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867398784:12345-0@lo:13: Request processed in 67us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380229.262702:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787380229.262734:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec361c700 x1874203867398784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380229.262750:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867398784:0@lo:13: 00000100:00080000:0.0:1787380229.262802:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000004:0.0:1787380229.907043:0:9937:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787380229.907296:0:9937:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787380230.221092:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380230.284037:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867398912:0@lo:41: 00000100:00100000:3.0:1787380230.284099:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380230.284271:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867398912 00000100:00100000:2.0:1787380230.284279:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867398912 00000100:00100000:2.0:1787380230.284332:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787380230.284342:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867398912:12345-0@lo:41: 00000004:00000024:2.0:1787380230.284398:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787380230.284444:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867398912:12345-0@lo:41: Request processed in 104us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380230.284451:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787380230.284601:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867398912:0@lo:41: 00000001:00080000:0.0:1787380230.938264:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1787380230.938281:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787380231.244047:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380232.278186:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787380232.820119:0:10039:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787380232.820308:0:10039:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787380233.292725:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787380233.809308:0:10087:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787380233.809318:0:10087:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1787380233.868554:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867399040:0@lo:13: 00000100:00100000:3.0:1787380233.868627:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380233.868743:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867399040 00000100:00100000:0.0:1787380233.868751:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867399040 00000100:00100000:0.0:1787380233.868864:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787380233.868875:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec310bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867399040:12345-0@lo:13: 00002000:00000024:0.0:1787380233.868902:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380233.868950:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec310bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867399040:12345-0@lo:13: Request processed in 77us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380233.868966:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787380233.869022:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff3fc2680 x1874203867399040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380233.869032:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787380233.869049:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867399040:0@lo:13: 00000100:00080000:3.0:1787380233.869182:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787380233.870278:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867399424:0@lo:400: 00000100:00100000:1.0:1787380233.870326:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380233.870351:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867399936:0@lo:400: 00000100:00100000:1.0:1787380233.870385:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380233.870402:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867400448:0@lo:400: 00000100:00100000:1.0:1787380233.870420:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380233.870438:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1787380233.870442:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867399296:0@lo:13: 00000100:00100000:1.0:1787380233.870459:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380233.870470:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867399808:0@lo:400: 00000100:00100000:1.0:1787380233.870495:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380233.870509:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867400320:0@lo:400: 00000100:00100000:1.0:1787380233.870524:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380233.870537:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867400832:0@lo:400: 00000100:00100000:1.0:1787380233.870551:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380233.870573:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867399936 00000100:00100000:1.0:1787380233.870578:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867399936 00000100:00100000:1.0:1787380233.870608:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787380233.870626:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec369ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867399936:12345-0@lo:400: 00000100:00100000:1.0:1787380233.870665:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec369ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867399936:12345-0@lo:400: Request processed in 51us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380233.870671:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787380233.870689:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867400448 00000100:00100000:1.0:1787380233.870693:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867400448 00000100:00100000:1.0:1787380233.870729:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867400320 00000100:00100000:1.0:1787380233.870732:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867400320 00000100:00100000:1.0:1787380233.870743:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867400832 00000100:00100000:1.0:1787380233.870745:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867400832 00000100:00100000:1.0:1787380233.870757:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787380233.870762:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec369b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867400448:12345-0@lo:400: 00000100:00100000:1.0:1787380233.870786:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec369b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867400448:12345-0@lo:400: Request processed in 24us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380233.870792:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787380233.870802:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787380233.870827:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec369a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867400320:12345-0@lo:400: 00000100:00100000:1.0:1787380233.870850:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec369a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867400320:12345-0@lo:400: Request processed in 43us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380233.870864:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787380233.870885:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787380233.870890:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec369b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867400832:12345-0@lo:400: 00000100:00100000:1.0:1787380233.870913:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec369b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867400832:12345-0@lo:400: Request processed in 23us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380233.870918:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787380233.870932:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867399808 00000100:00100000:1.0:1787380233.870935:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867399808 00000100:00100000:1.0:1787380233.870956:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787380233.870962:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867399808:12345-0@lo:400: 00000100:00100000:1.0:1787380233.870984:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867399808:12345-0@lo:400: Request processed in 23us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380233.870989:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1787380233.871113:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787380233.871117:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787380233.871139:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34ece00 x1874203867399808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380233.871151:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867399808:0@lo:400: 00010000:00080000:1.0:1787380233.871161:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34ed180 x1874203867400320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380233.871169:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867400320:0@lo:400: 00010000:00080000:1.0:1787380233.871177:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3699880 x1874203867400832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380233.871183:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1787380233.871194:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867400832:0@lo:400: 00000100:00100000:1.0:1787380233.871208:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867399936:0@lo:400: 00010000:00080000:1.0:1787380233.871216:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34ee680 x1874203867400448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380233.871225:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867400448:0@lo:400: 00000100:00100000:0.0:1787380233.872859:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867399296 00000100:00100000:0.0:1787380233.872878:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867399296 00000100:00100000:0.0:1787380233.872915:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787380233.872922:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867399296:12345-0@lo:13: 00002000:00000024:0.0:1787380233.872940:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380233.872991:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867399296:12345-0@lo:13: Request processed in 69us (2530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380233.872997:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787380233.873118:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867399168:0@lo:41: 00000100:00100000:0.0:1787380233.873148:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380233.873167:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867399680:0@lo:400: 00000100:00100000:0.0:1787380233.873182:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380233.873196:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867400192:0@lo:400: 00000100:00100000:0.0:1787380233.873213:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380233.873226:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1874203867400704:0@lo:400: 00000100:00100000:0.0:1787380233.873244:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380233.873260:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787380233.873266:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867399552:0@lo:400: 00000100:00100000:0.0:1787380233.873282:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380233.873294:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1874203867400064:0@lo:400: 00000100:00100000:0.0:1787380233.873320:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380233.873329:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1874203867400576:0@lo:400: 00000100:00100000:0.0:1787380233.873346:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380233.873362:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867400192 00000100:00100000:0.0:1787380233.873465:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867400192 00000100:00100000:0.0:1787380233.873493:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867400704 00000100:00100000:0.0:1787380233.873496:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867400704 00000100:00100000:0.0:1787380233.873506:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867399552 00000100:00100000:0.0:1787380233.873508:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867399552 00000100:00100000:0.0:1787380233.873517:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867400064 00000100:00100000:0.0:1787380233.873519:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867400064 00000100:00100000:0.0:1787380233.873527:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867400576 00000100:00100000:0.0:1787380233.873529:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867400576 00000100:00100000:0.0:1787380233.873539:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787380233.873544:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867400192:12345-0@lo:400: 00000100:00100000:0.0:1787380233.873576:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867400192:12345-0@lo:400: Request processed in 31us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380233.873581:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787380233.873591:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787380233.873596:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874203867400704:12345-0@lo:400: 00000100:00100000:0.0:1787380233.873628:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874203867400704:12345-0@lo:400: Request processed in 31us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380233.873635:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787380233.873644:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787380233.873649:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867399552:12345-0@lo:400: 00000100:00100000:0.0:1787380233.873671:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867399552:12345-0@lo:400: Request processed in 22us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380233.873677:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787380233.873694:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787380233.873700:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874203867400064:12345-0@lo:400: 00000100:00080000:2.0:1787380233.873788:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380233.873793:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787380233.873877:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867399424 00000100:00100000:3.0:1787380233.873882:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867399424 00000100:00100000:3.0:1787380233.873907:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787380233.873918:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3642:x1874203867399424:12345-0@lo:400: 00000100:00100000:1.0:1787380233.876888:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867399168 00000100:00100000:1.0:1787380233.876901:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867399168 00000100:00100000:1.0:1787380233.876939:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867399680 00000100:00100000:1.0:1787380233.876942:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867399680 00000100:00100000:1.0:1787380233.876956:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787380233.876963:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1874203867399168:12345-0@lo:41: 00000004:00000024:1.0:1787380233.876994:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787380233.878591:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3642:x1874203867399424:12345-0@lo:400: Request processed in 4667us (8259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380233.878603:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787380233.881175:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874203867400064:12345-0@lo:400: Request processed in 7467us (7845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380233.881189:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787380233.881217:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787380233.881321:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874203867400576:12345-0@lo:400: 00000100:00100000:0.0:1787380233.881627:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874203867400576:12345-0@lo:400: Request processed in 402us (8278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380233.881634:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1787380233.881679:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34edc00 x1874203867399552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380233.881694:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867399552:0@lo:400: 00010000:00080000:0.0:1787380233.881707:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34ed880 x1874203867400064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380233.881715:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1874203867400064:0@lo:400: 00010000:00080000:2.0:1787380233.881952:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34edf80 x1874203867399296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380233.881969:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867399296:0@lo:13: 00000100:00100000:2.0:1787380233.881980:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867399424:0@lo:400: 00000100:00100000:1.0:1787380233.882151:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1874203867399168:12345-0@lo:41: Request processed in 5187us (9001us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380233.882160:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787380233.882175:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787380233.882182:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867399680:12345-0@lo:400: 00000100:00100000:1.0:1787380233.882210:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867399680:12345-0@lo:400: Request processed in 30us (9027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380233.882216:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1787380233.882337:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec369a680 x1874203867400576/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380233.882347:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1874203867400576:0@lo:400: 00000100:00100000:0.0:1787380233.882358:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867399168:0@lo:41: 00000100:00100000:0.0:1787380233.883207:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867399680:0@lo:400: 00010000:00080000:0.0:1787380233.883236:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34ec700 x1874203867400192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380233.883246:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867400192:0@lo:400: 00010000:00080000:0.0:1787380233.883267:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec369aa00 x1874203867400704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380233.883275:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1874203867400704:0@lo:400: 00000100:00100000:3.0:1787380234.236420:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380234.236502:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848474752 00000100:00100000:2.0:1787380234.236511:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848474752 00000100:00100000:2.0:1787380234.236549:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 181 00000100:00100000:2.0:1787380234.236556:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2396:x1874203848474752:12345-192.168.206.30@tcp:250: 00010000:00080000:2.0:1787380234.236580:0:6515:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 2facc94b-d95a-46d6-aa1a-c4299279749f@192.168.206.30@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:2.0:1787380234.236606:0:6515:0:(genops.c:1406:class_connect()) connect: client 2facc94b-d95a-46d6-aa1a-c4299279749f, cookie 0xcf3c46fdcad68cb7 00000100:00080000:2.0:1787380234.239657:0:6515:0:(import.c:65:import_set_state_nolock()) ffff9d6ec376b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787380234.239726:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+5:2396:x1874203848474752:12345-192.168.206.30@tcp:250: Request processed in 3166us (3309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380234.239737:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 181 00000100:00100000:3.0:1787380234.258737:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380234.259530:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848474880 00000100:00100000:0.0:1787380234.259541:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848474880 00000100:00100000:0.0:1787380234.259590:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 182 00000100:00100000:0.0:1787380234.259598:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+5:6155:x1874203848474880:12345-192.168.206.30@tcp:101: 00010000:00010000:0.0:1787380234.259621:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380234.259638:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68cbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0aad5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380234.259662:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68cbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aad5 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380234.259674:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68cbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aad5 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380234.259682:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9b800, rc 0) 00000100:00100000:0.0:1787380234.259743:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+6:6155:x1874203848474880:12345-192.168.206.30@tcp:101: Request processed in 145us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380234.259750:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 182 00000100:00100000:3.0:1787380234.263640:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380234.263727:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848475008 00000100:00100000:2.0:1787380234.263736:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848475008 00000100:00100000:2.0:1787380234.263782:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 183 00000100:00100000:2.0:1787380234.263791:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+6:6155:x1874203848475008:12345-192.168.206.30@tcp:501: 00000100:00100000:2.0:1787380234.264157:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+6:6155:x1874203848475008:12345-192.168.206.30@tcp:501: Request processed in 366us (523us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787380234.264176:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 183 00000100:00100000:2.0:1787380234.270570:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380234.270671:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848475136 00000100:00100000:3.0:1787380234.270681:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848475136 00000100:00100000:3.0:1787380234.270737:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 184 00000100:00100000:3.0:1787380234.270746:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+6:6155:x1874203848475136:12345-192.168.206.30@tcp:101: 00010000:00010000:3.0:1787380234.270759:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380234.270775:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5fdb600/0xcf3c46fdcad68cc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0aadc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380234.270800:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5fdb600/0xcf3c46fdcad68cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aadc expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380234.270839:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5fdb600/0xcf3c46fdcad68cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aadc expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380234.270849:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fdb600, rc 0) 00000100:00100000:3.0:1787380234.271134:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+7:6155:x1874203848475136:12345-192.168.206.30@tcp:101: Request processed in 388us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380234.271142:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 184 00000100:00100000:0.0:1787380234.286840:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380234.287144:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848475264 00000100:00100000:2.0:1787380234.287153:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848475264 00000100:00100000:2.0:1787380234.287208:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 185 00000100:00100000:2.0:1787380234.287217:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+7:6155:x1874203848475264:12345-192.168.206.30@tcp:501: 00000100:00100000:2.0:1787380234.287350:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+8:6155:x1874203848475264:12345-192.168.206.30@tcp:501: Request processed in 134us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380234.287358:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 185 00000100:00100000:1.0:1787380234.293278:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380234.293411:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848475392 00000100:00100000:3.0:1787380234.293419:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848475392 00000100:00100000:3.0:1787380234.293464:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 186 00000100:00100000:3.0:1787380234.293483:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+8:6155:x1874203848475392:12345-192.168.206.30@tcp:503: 00000100:00100000:3.0:1787380234.293602:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+8:6155:x1874203848475392:12345-192.168.206.30@tcp:503: Request processed in 119us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380234.293622:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 186 00000100:00100000:3.0:1787380234.305081:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380234.305220:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848475520 00000100:00100000:0.0:1787380234.305228:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848475520 00000100:00100000:0.0:1787380234.305275:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 187 00000100:00100000:0.0:1787380234.305284:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+8:6174:x1874203848475520:12345-192.168.206.30@tcp:502: 00000100:00100000:0.0:1787380234.305428:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+8:6174:x1874203848475520:12345-192.168.206.30@tcp:502: Request processed in 145us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380234.305441:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 187 00010000:00010000:0.0:1787380234.318292:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380234.338343:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380234.339864:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848475648 00000100:00100000:2.0:1787380234.339882:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848475648 00000100:00100000:2.0:1787380234.339933:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 188 00000100:00100000:2.0:1787380234.339942:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+8:6174:x1874203848475648:12345-192.168.206.30@tcp:502: 00000100:00100000:2.0:1787380234.340085:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+8:6174:x1874203848475648:12345-192.168.206.30@tcp:502: Request processed in 143us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380234.340093:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 188 00000100:00100000:1.0:1787380234.352282:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380234.352414:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848475776 00000100:00100000:3.0:1787380234.352422:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848475776 00000100:00100000:3.0:1787380234.352471:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 189 00000100:00100000:3.0:1787380234.352480:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+8:6155:x1874203848475776:12345-192.168.206.30@tcp:101: 00010000:00010000:3.0:1787380234.352495:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380234.352510:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5fda800/0xcf3c46fdcad68ccc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ab0d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380234.352536:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5fda800/0xcf3c46fdcad68ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab0d expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380234.352546:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5fda800/0xcf3c46fdcad68ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab0d expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380234.352556:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fda800, rc 0) 00000100:00100000:3.0:1787380234.352606:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+9:6155:x1874203848475776:12345-192.168.206.30@tcp:101: Request processed in 128us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380234.352623:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 189 00000100:00100000:3.0:1787380234.355212:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380234.355330:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848475904 00000100:00100000:0.0:1787380234.355337:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848475904 00000100:00100000:0.0:1787380234.355393:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 190 00000100:00100000:0.0:1787380234.355402:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+9:6155:x1874203848475904:12345-192.168.206.30@tcp:256: 20000000:01000000:0.0:1787380234.355422:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787380234.355442:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787380234.355446:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787380234.355449:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787380234.355451:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787380234.355454:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1787380234.361065:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+9:6155:x1874203848475904:12345-192.168.206.30@tcp:256: Request processed in 5655us (5862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380234.361079:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 190 00000100:00100000:1.0:1787380234.367285:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380234.367668:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848476032 00000100:00100000:2.0:1787380234.367677:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848476032 00000100:00100000:2.0:1787380234.367734:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 191 00000100:00100000:2.0:1787380234.367743:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+9:6155:x1874203848476032:12345-192.168.206.30@tcp:101: 00010000:00010000:2.0:1787380234.367759:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380234.367774:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68cd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ab14 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380234.367800:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68cd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab14 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380234.367859:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68cd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab14 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380234.367877:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d47000, rc 0) 00000100:00100000:2.0:1787380234.367918:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6155:x1874203848476032:12345-192.168.206.30@tcp:101: Request processed in 177us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380234.367925:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 191 00000100:00100000:2.0:1787380234.369646:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380234.370849:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848476160 00000100:00100000:3.0:1787380234.370859:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848476160 00000100:00100000:3.0:1787380234.370914:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 192 00000100:00100000:3.0:1787380234.370922:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6155:x1874203848476160:12345-192.168.206.30@tcp:501: 00000100:00100000:3.0:1787380234.371061:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6155:x1874203848476160:12345-192.168.206.30@tcp:501: Request processed in 140us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380234.371069:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 192 00000100:00100000:0.0:1787380234.374752:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380234.374862:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848476288 00000100:00100000:3.0:1787380234.374880:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848476288 00000100:00100000:3.0:1787380234.374927:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 193 00000100:00100000:3.0:1787380234.374936:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6155:x1874203848476288:12345-192.168.206.30@tcp:503: 00000100:00100000:3.0:1787380234.375066:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6155:x1874203848476288:12345-192.168.206.30@tcp:503: Request processed in 131us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380234.375074:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 193 00000100:00100000:0.0:1787380234.380161:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380234.380182:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867400960:0@lo:13: 00000100:00100000:0.0:1787380234.380248:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380234.380400:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867400960 00000100:00100000:2.0:1787380234.380408:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867400960 00000100:00100000:2.0:1787380234.380450:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787380234.380458:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867400960:12345-0@lo:13: 00002000:00000024:2.0:1787380234.380501:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380234.380546:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867400960:12345-0@lo:13: Request processed in 89us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380234.380553:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787380234.382144:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec361f800 x1874203867400960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380234.382164:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867400960:0@lo:13: 00000100:00100000:2.0:1787380234.385891:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380234.386002:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867401088:0@lo:13: 00000100:00100000:0.0:1787380234.386045:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380234.386183:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867401088 00000100:00100000:2.0:1787380234.386190:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867401088 00000100:00100000:2.0:1787380234.386242:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787380234.386250:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867401088:12345-0@lo:13: 00002000:00000024:2.0:1787380234.386269:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380234.386306:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867401088:12345-0@lo:13: Request processed in 57us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380234.386313:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787380234.386524:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec361c700 x1874203867401088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380234.386541:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867401088:0@lo:13: 00000100:00100000:3.0:1787380234.386651:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848476416 00000100:00100000:3.0:1787380234.386656:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848476416 00000100:00100000:3.0:1787380234.386688:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 194 00000100:00100000:3.0:1787380234.386696:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6179:x1874203848476416:12345-192.168.206.30@tcp:502: 00000100:00100000:3.0:1787380234.386828:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6179:x1874203848476416:12345-192.168.206.30@tcp:502: Request processed in 115us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380234.386835:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 194 00000100:00100000:2.0:1787380234.391024:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380234.391115:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848476544 00000100:00100000:0.0:1787380234.391128:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848476544 00000100:00100000:0.0:1787380234.391175:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 195 00000100:00100000:0.0:1787380234.391184:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6179:x1874203848476544:12345-192.168.206.30@tcp:502: 00000100:00100000:0.0:1787380234.391315:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6179:x1874203848476544:12345-192.168.206.30@tcp:502: Request processed in 131us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380234.391330:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 195 00000100:00100000:0.0:1787380234.395806:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380234.395874:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380234.395974:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848476672 00000100:00100000:1.0:1787380234.395983:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848476672 00000100:00100000:1.0:1787380234.396011:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848476928 00000100:00100000:1.0:1787380234.396013:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848476928 00000100:00100000:1.0:1787380234.396024:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:1.0:1787380234.396044:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1874203848476672:12345-192.168.206.30@tcp:38: 00010000:00080000:1.0:1787380234.396072:0:6523:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:1.0:1787380234.396116:0:6523:0:(genops.c:1406:class_connect()) connect: client 7da54272-8859-4cb3-ba98-d1d4e18c7c38, cookie 0xcf3c46fdcad68cda 00000004:00100000:1.0:1787380234.396138:0:6523:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787380234.396344:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2754000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380234.396415:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2396:x1874203848476672:12345-192.168.206.30@tcp:38: Request processed in 370us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380234.396422:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:1.0:1787380234.396438:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:1.0:1787380234.396442:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2396:x1874203848476928:12345-192.168.206.30@tcp:38: 00010000:00080000:1.0:1787380234.396455:0:6523:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp t0 exp 0000000000000000 cur 244 last 0 00000020:00000080:1.0:1787380234.396485:0:6523:0:(genops.c:1406:class_connect()) connect: client 7da54272-8859-4cb3-ba98-d1d4e18c7c38, cookie 0xcf3c46fdcad68ce1 00000004:00100000:1.0:1787380234.396495:0:6523:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787380234.396600:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9d6ff5ca9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380234.396634:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2396:x1874203848476928:12345-192.168.206.30@tcp:38: Request processed in 190us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380234.396640:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 8 00010000:00010000:3.0:1787380235.340861:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380235.404509:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867401216:0@lo:41: 00000100:00100000:0.0:1787380235.404584:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380235.407481:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867401216 00000100:00100000:2.0:1787380235.407495:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867401216 00000100:00100000:2.0:1787380235.407552:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787380235.407562:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867401216:12345-0@lo:41: 00000004:00000024:2.0:1787380235.407596:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787380235.408108:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867401216:12345-0@lo:41: Request processed in 547us (3522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380235.408117:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787380235.408169:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867401216:0@lo:41: 00000100:00100000:2.0:1787380235.438429:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380235.438516:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848476800 00000100:00100000:1.0:1787380235.438525:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848476800 00000100:00100000:1.0:1787380235.438603:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:1.0:1787380235.438623:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:0:x1874203848476800:12345-192.168.206.30@tcp:41: 00000004:00000024:1.0:1787380235.438671:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1787380235.438770:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:0:x1874203848476800:12345-192.168.206.30@tcp:41: Request processed in 148us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380235.438786:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00080000:2.0:1787380235.439341:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380235.451727:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380235.451853:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848477184 00000100:00100000:2.0:1787380235.451862:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848477184 00000100:00100000:2.0:1787380235.451917:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:2.0:1787380235.451927:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:6155:x1874203848477184:12345-192.168.206.30@tcp:41: 00000004:00000024:2.0:1787380235.451969:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787380235.452030:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:6155:x1874203848477184:12345-192.168.206.30@tcp:41: Request processed in 105us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380235.452037:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:0.0:1787380235.459175:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380235.459275:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848477056 00000100:00100000:3.0:1787380235.459286:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848477056 00000100:00100000:3.0:1787380235.459363:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:3.0:1787380235.459374:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:0:x1874203848477056:12345-192.168.206.30@tcp:41: 00000004:00000024:3.0:1787380235.459425:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787380235.459502:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:0:x1874203848477056:12345-192.168.206.30@tcp:41: Request processed in 130us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380235.459510:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00080000:2.0:1787380235.460379:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787380235.467258:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380235.467355:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848477312 00000100:00100000:1.0:1787380235.467375:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848477312 00000100:00100000:1.0:1787380235.467429:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:1.0:1787380235.467438:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:6155:x1874203848477312:12345-192.168.206.30@tcp:40: 00000100:00100000:1.0:1787380235.467523:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:6155:x1874203848477312:12345-192.168.206.30@tcp:40: Request processed in 86us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380235.467531:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:1.0:1787380235.478874:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380235.478925:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380235.479148:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848477696 00000100:00100000:2.0:1787380235.479158:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848477696 00000100:00100000:2.0:1787380235.479210:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:2.0:1787380235.479219:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:6155:x1874203848477696:12345-192.168.206.30@tcp:900: 00000100:00100000:2.0:1787380235.479305:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:6155:x1874203848477696:12345-192.168.206.30@tcp:900: Request processed in 86us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380235.479314:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:2.0:1787380235.484875:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848477824 00000100:00100000:2.0:1787380235.484903:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848477824 00000100:00100000:2.0:1787380235.484981:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 196 00000100:00100000:2.0:1787380235.484992:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2398:x1874203848477824:12345-192.168.206.30@tcp:400: 00000100:00100000:2.0:1787380235.490452:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2398:x1874203848477824:12345-192.168.206.30@tcp:400: Request processed in 5452us (11515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380235.490468:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 196 00000100:00100000:0.0:1787380235.502572:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380235.502616:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380235.502671:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380235.502719:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848477952 00000100:00100000:0.0:1787380235.502728:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848477952 00000100:00100000:0.0:1787380235.502787:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:0.0:1787380235.502798:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:6155:x1874203848477952:12345-192.168.206.30@tcp:33: 00000100:00100000:1.0:1787380235.504047:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848477440 00000100:00100000:1.0:1787380235.504055:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848477440 00000100:00100000:1.0:1787380235.504081:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848477568 00000100:00100000:1.0:1787380235.504084:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848477568 00000100:00100000:1.0:1787380235.504102:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:1.0:1787380235.504121:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2396:x1874203848477440:12345-192.168.206.30@tcp:8: 00010000:00080000:1.0:1787380235.504147:0:8871:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:1.0:1787380235.504175:0:8871:0:(genops.c:1406:class_connect()) connect: client 7da54272-8859-4cb3-ba98-d1d4e18c7c38, cookie 0xcf3c46fdcad68ce8 00002000:00100000:1.0:1787380235.504185:0:8871:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7da54272-8859-4cb3-ba98-d1d4e18c7c38/ffff9d6ff4ff8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787380235.504195:0:8871:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787380235.504336:0:8871:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787380235.504361:0:8871:0:(import.c:65:import_set_state_nolock()) ffff9d6ff4ffa800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380235.504412:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2396:x1874203848477440:12345-192.168.206.30@tcp:8: Request processed in 291us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380235.504420:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:1.0:1787380235.504435:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:1.0:1787380235.504439:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2396:x1874203848477568:12345-192.168.206.30@tcp:8: 00010000:00080000:1.0:1787380235.504460:0:8871:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:1.0:1787380235.504484:0:8871:0:(genops.c:1406:class_connect()) connect: client 7da54272-8859-4cb3-ba98-d1d4e18c7c38, cookie 0xcf3c46fdcad68cef 00002000:00100000:1.0:1787380235.504489:0:8871:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7da54272-8859-4cb3-ba98-d1d4e18c7c38/ffff9d6fff5ff000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787380235.504494:0:8871:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787380235.504587:0:8871:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787380235.504600:0:8871:0:(import.c:65:import_set_state_nolock()) ffff9d6fff5fb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380235.504634:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2396:x1874203848477568:12345-192.168.206.30@tcp:8: Request processed in 193us (2027us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380235.504641:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 17 00000004:00080000:0.0:1787380235.531145:0:6524:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 28255us 00000004:00200000:3.0:1787380235.565230:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787380235.565348:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:6155:x1874203848477952:12345-192.168.206.30@tcp:33: Request processed in 62547us (62672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380235.565365:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:0.0:1787380235.893162:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380235.893260:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848478080 00000100:00100000:2.0:1787380235.893269:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848478080 00000100:00100000:2.0:1787380235.893328:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:2.0:1787380235.893339:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:6197:x1874203848478080:12345-192.168.206.30@tcp:101: 00010000:00010000:2.0:1787380235.893357:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380235.893390:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad68cf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ab45 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380235.893458:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad68cfd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380235.893470:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad68cfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380235.893484:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad68cfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380235.893527:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787380235.893531:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787380235.893546:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad68cfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380235.893571:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad68cf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab45 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380235.893617:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad68cfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab45 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380235.893625:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25a8800) 00010000:00010000:2.0:1787380235.893627:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787380235.893630:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46400, rc 0) 00000100:00100000:2.0:1787380235.893686:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:6197:x1874203848478080:12345-192.168.206.30@tcp:101: Request processed in 349us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380235.893693:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 13 00010000:00010000:2.0:1787380236.366099:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380237.387958:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380238.184694:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380238.185326:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848478208 00000100:00100000:2.0:1787380238.185336:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848478208 00000100:00100000:2.0:1787380238.185463:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:2.0:1787380238.185472:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:6249:x1874203848478208:12345-192.168.206.30@tcp:41: 00000004:00000024:2.0:1787380238.185504:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1787380238.185571:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:6249:x1874203848478208:12345-192.168.206.30@tcp:41: Request processed in 100us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380238.185578:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00080000:1.0:1787380238.188557:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380238.192067:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380238.192266:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848478336 00000100:00100000:1.0:1787380238.192276:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848478336 00000100:00100000:1.0:1787380238.192392:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:1.0:1787380238.192405:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:6249:x1874203848478336:12345-192.168.206.30@tcp:41: 00000004:00000024:1.0:1787380238.192449:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380238.192522:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:6249:x1874203848478336:12345-192.168.206.30@tcp:41: Request processed in 120us (463us total) trans 0 rc 0/0 00000100:00080000:2.0:1787380238.192529:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787380238.192531:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:3.0:1787380238.195545:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380238.195671:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848478464 00000100:00100000:2.0:1787380238.195742:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848478464 00000100:00100000:2.0:1787380238.195984:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:2.0:1787380238.195994:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:6249:x1874203848478464:12345-192.168.206.30@tcp:13: 00002000:00000024:2.0:1787380238.196024:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380238.196130:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:6249:x1874203848478464:12345-192.168.206.30@tcp:13: Request processed in 136us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380238.196152:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00080000:1.0:1787380238.196211:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380238.200049:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380238.200442:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848478592 00000100:00100000:3.0:1787380238.200452:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848478592 00000100:00100000:3.0:1787380238.200571:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:3.0:1787380238.200581:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:6249:x1874203848478592:12345-192.168.206.30@tcp:13: 00002000:00000024:3.0:1787380238.200623:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380238.200692:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:6249:x1874203848478592:12345-192.168.206.30@tcp:13: Request processed in 112us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380238.200700:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00080000:1.0:1787380238.201720:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787380238.412040:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380238.988414:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867401344:0@lo:13: 00000100:00100000:0.0:1787380238.988474:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380238.988537:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380238.988544:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867401472:0@lo:41: 00000100:00100000:0.0:1787380238.988569:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380238.988609:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867401600:0@lo:13: 00000100:00100000:0.0:1787380238.988633:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380238.988670:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867401344 00000100:00100000:0.0:1787380238.988677:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867401344 00000100:00100000:0.0:1787380238.988719:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867401600 00000100:00100000:0.0:1787380238.988722:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867401600 00000100:00100000:0.0:1787380238.988739:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787380238.988746:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867401344:12345-0@lo:13: 00002000:00000024:0.0:1787380238.988765:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380238.988806:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867401344:12345-0@lo:13: Request processed in 59us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380238.988828:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787380238.988843:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787380238.988850:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867401600:12345-0@lo:13: 00002000:00000024:0.0:1787380238.988859:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380238.988886:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867401600:12345-0@lo:13: Request processed in 37us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380238.988892:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787380238.988908:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867401472 00000100:00100000:0.0:1787380238.988911:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867401472 00000100:00100000:0.0:1787380238.989764:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787380238.989774:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867401472:12345-0@lo:41: 00000004:00000024:0.0:1787380238.989798:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1787380238.989855:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867401472:12345-0@lo:41: Request processed in 83us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380238.989869:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1787380238.989890:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787380238.989917:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5f42a00 x1874203867401600/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380238.989934:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867401600:0@lo:13: 00000100:00100000:0.0:1787380238.989964:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867401472:0@lo:41: 00010000:00080000:0.0:1787380238.989974:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5f41500 x1874203867401344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380238.989985:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867401344:0@lo:13: 00000100:00100000:1.0:1787380238.991736:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867402112:0@lo:400: 00000100:00100000:1.0:1787380238.991788:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380238.991846:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867402624:0@lo:400: 00000100:00100000:1.0:1787380238.991871:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380238.991894:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787380238.991910:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867401728:0@lo:400: 00000100:00100000:1.0:1787380238.991940:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380238.991971:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867402240:0@lo:400: 00000100:00100000:1.0:1787380238.992006:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380238.992023:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867402752:0@lo:400: 00000100:00100000:1.0:1787380238.992043:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380238.992069:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867402624 00000100:00100000:1.0:1787380238.992075:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867402624 00000100:00100000:2.0:1787380238.992417:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867402112 00000100:00100000:2.0:1787380238.992422:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867402112 00000100:00100000:2.0:1787380238.992453:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787380238.992462:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867402112:12345-0@lo:400: 00000100:00100000:2.0:1787380238.992514:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867402112:12345-0@lo:400: Request processed in 53us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380238.992522:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787380238.992597:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867402240 00000100:00100000:0.0:1787380238.992601:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867402240 00000100:00100000:0.0:1787380238.992631:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867402752 00000100:00100000:0.0:1787380238.992635:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867402752 00000100:00100000:0.0:1787380238.992650:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787380238.992656:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec369bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867402240:12345-0@lo:400: 00000100:00100000:0.0:1787380238.992689:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec369bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867402240:12345-0@lo:400: Request processed in 34us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380238.992695:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787380238.992706:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787380238.992712:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867402752:12345-0@lo:400: 00000100:00100000:0.0:1787380238.992736:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867402752:12345-0@lo:400: Request processed in 25us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380238.992742:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787380238.992767:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867401984:0@lo:400: 00000100:00100000:0.0:1787380238.992790:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380238.992836:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867402496:0@lo:400: 00000100:00100000:0.0:1787380238.992858:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380238.992878:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787380238.992884:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867401856:0@lo:400: 00000100:00100000:0.0:1787380238.992905:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380238.992921:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867402368:0@lo:400: 00000100:00100000:0.0:1787380238.992940:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380238.992952:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867402880:0@lo:400: 00000100:00100000:0.0:1787380238.992969:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380238.993166:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867401728 00000100:00100000:3.0:1787380238.993171:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867401728 00000100:00100000:3.0:1787380238.993294:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787380238.993302:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867401728:12345-0@lo:400: 00000100:00100000:3.0:1787380238.995634:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867401728:12345-0@lo:400: Request processed in 2327us (3686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380238.995658:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787380238.998134:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867401728:0@lo:400: 00000100:00100000:2.0:1787380238.998155:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867402240:0@lo:400: 00000100:00100000:2.0:1787380238.998167:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867402752:0@lo:400: 00000100:00100000:2.0:1787380238.998178:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867402112:0@lo:400: 00000100:00100000:2.0:1787380238.998219:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867402496 00000100:00100000:2.0:1787380238.998225:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867402496 00000100:00100000:2.0:1787380238.998267:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787380238.998275:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3699f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867402624:12345-0@lo:400: 00000100:00100000:2.0:1787380238.998493:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3699f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867402624:12345-0@lo:400: Request processed in 218us (6620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380238.998500:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787380238.998514:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787380238.998520:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867402496:12345-0@lo:400: 00000100:00100000:2.0:1787380238.998556:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867402496:12345-0@lo:400: Request processed in 37us (5697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380238.998562:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787380238.998610:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5d99880 x1874203867402624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380238.998622:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867402624:0@lo:400: 00010000:00080000:2.0:1787380238.998648:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5d99f80 x1874203867402496/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380238.998657:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867402496:0@lo:400: 00000100:00100000:0.0:1787380238.998766:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867401984 00000100:00100000:0.0:1787380238.998772:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867401984 00000100:00100000:0.0:1787380238.998793:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867401856 00000100:00100000:0.0:1787380238.998796:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867401856 00000100:00100000:0.0:1787380238.998822:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867402368 00000100:00100000:0.0:1787380238.998826:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867402368 00000100:00100000:0.0:1787380238.998841:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867402880 00000100:00100000:0.0:1787380238.998844:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867402880 00000100:00100000:0.0:1787380238.998857:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787380238.998863:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867401984:12345-0@lo:400: 00000100:00100000:0.0:1787380238.998903:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867401984:12345-0@lo:400: Request processed in 40us (6111us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380238.998909:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787380238.998920:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787380238.998926:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867401856:12345-0@lo:400: 00000100:00100000:0.0:1787380238.998952:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867401856:12345-0@lo:400: Request processed in 26us (6046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380238.998957:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787380238.998968:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787380238.998993:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867402368:12345-0@lo:400: 00000100:00100000:0.0:1787380238.999019:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867402368:12345-0@lo:400: Request processed in 29us (6079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380238.999025:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787380238.999036:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787380238.999041:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867402880:12345-0@lo:400: 00000100:00100000:0.0:1787380238.999066:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867402880:12345-0@lo:400: Request processed in 24us (6095us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380238.999071:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1787380238.999086:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787380238.999090:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787380238.999092:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380239.000627:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867401856:0@lo:400: 00010000:00080000:2.0:1787380239.000643:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5d99c00 x1874203867402368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380239.000652:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867402368:0@lo:400: 00010000:00080000:2.0:1787380239.000663:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5d9bb80 x1874203867402880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380239.000672:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867402880:0@lo:400: 00000100:00100000:2.0:1787380239.000683:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867401984:0@lo:400: 00010000:00010000:2.0:1787380239.437726:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787380239.502872:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000100:00100000:0.0:1787380239.503270:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867403008:0@lo:13: 00000100:00100000:0.0:1787380239.503347:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380239.503449:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867403008 00000100:00100000:2.0:1787380239.503456:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867403008 00000100:00100000:2.0:1787380239.503503:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787380239.503512:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867403008:12345-0@lo:13: 00002000:00000024:2.0:1787380239.503533:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380239.503575:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867403008:12345-0@lo:13: Request processed in 64us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380239.503581:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787380239.503680:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec361c700 x1874203867403008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380239.503697:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867403008:0@lo:13: 00000100:00100000:0.0:1787380239.503800:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380239.503847:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867403136:0@lo:13: 00000100:00100000:0.0:1787380239.503875:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380239.503904:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867403136 00000100:00100000:0.0:1787380239.503908:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867403136 00000100:00100000:0.0:1787380239.503931:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787380239.503937:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867403136:12345-0@lo:13: 00002000:00000024:0.0:1787380239.503948:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380239.503978:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867403136:12345-0@lo:13: Request processed in 41us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380239.503990:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787380239.504017:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5d9aa00 x1874203867403136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380239.504028:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867403136:0@lo:13: 00010000:00010000:0.0:1787380240.461641:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787380240.527252:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000001:00100000:3.0:1787380240.527571:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000100:00100000:0.0:1787380240.539028:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380240.539053:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867403264:0@lo:41: 00000100:00100000:0.0:1787380240.539116:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380240.539228:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867403264 00000100:00100000:1.0:1787380240.539236:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867403264 00000100:00100000:1.0:1787380240.539290:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787380240.539299:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867403264:12345-0@lo:41: 00000004:00000024:1.0:1787380240.539328:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380240.539384:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867403264:12345-0@lo:41: Request processed in 73us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380240.539391:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787380240.539434:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867403264:0@lo:41: 00000100:00100000:0.0:1787380240.547538:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380240.547593:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380240.547626:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380240.547631:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848478848 00000100:00100000:1.0:1787380240.547641:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848478848 00000100:00100000:0.0:1787380240.547644:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380240.547664:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380240.547680:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848478976 00000100:00100000:0.0:1787380240.547683:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848478976 00000100:00100000:1.0:1787380240.547693:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 57 00000100:00100000:0.0:1787380240.547701:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787380240.547703:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2399:x1874203848478848:12345-192.168.206.30@tcp:400: 00000100:00100000:0.0:1787380240.547707:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:0.0:1787380240.547721:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787380240.547724:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380240.547732:0:6522:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787380240.547740:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00100000:0.0:1787380240.547746:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848478976:12345-192.168.206.30@tcp:400: 00000100:00100000:1.0:1787380240.547785:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2399:x1874203848478848:12345-192.168.206.30@tcp:400: Request processed in 83us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380240.547791:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848479104 00000100:00100000:1.0:1787380240.547792:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 57 00000100:00100000:2.0:1787380240.547795:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848479104 00000100:00100000:2.0:1787380240.547852:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848479232 00000100:00100000:2.0:1787380240.547856:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848479232 00000100:00100000:2.0:1787380240.547877:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:2.0:1787380240.547884:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2399:x1874203848479104:12345-192.168.206.30@tcp:400: 00000100:00100000:1.0:1787380240.547930:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:1.0:1787380240.547945:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848479232:12345-192.168.206.30@tcp:400: 00000100:00100000:0.0:1787380240.550936:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848478976:12345-192.168.206.30@tcp:400: Request processed in 3178us (3278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380240.550951:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00080000:0.0:1787380240.551366:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380240.551622:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380240.551648:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848478720 00000100:00100000:0.0:1787380240.551656:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848478720 00000100:00100000:0.0:1787380240.551851:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 198 00000100:00100000:0.0:1787380240.551861:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2399:x1874203848478720:12345-192.168.206.30@tcp:400: 00000100:00100000:0.0:1787380240.551926:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2399:x1874203848478720:12345-192.168.206.30@tcp:400: Request processed in 66us (4297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380240.551934:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 198 00000100:00100000:2.0:1787380240.552086:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2399:x1874203848479104:12345-192.168.206.30@tcp:400: Request processed in 4201us (4491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380240.552096:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:1.0:1787380240.552106:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848479232:12345-192.168.206.30@tcp:400: Request processed in 4161us (4439us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380240.552113:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 16 00000001:02000400:0.0:1787380241.304710:0:10186:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787380241.486292:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787380241.552257:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7da54272-8859-4cb3-ba98-d1d4e18c7c38 00010000:00010000:2.0:1787380242.508702:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380243.532190:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380244.108223:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec36d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867403392:0@lo:13: 00000100:00100000:0.0:1787380244.108281:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380244.108326:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380244.108332:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec36d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867403520:0@lo:13: 00000100:00100000:0.0:1787380244.108350:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380244.108382:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867403392 00000100:00100000:0.0:1787380244.108388:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867403392 00000100:00100000:0.0:1787380244.108424:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867403520 00000100:00100000:0.0:1787380244.108426:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867403520 00000100:00100000:0.0:1787380244.108442:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787380244.108450:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867403392:12345-0@lo:13: 00002000:00000024:0.0:1787380244.108475:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380244.108601:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867403648:0@lo:41: 00000100:00100000:3.0:1787380244.108631:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380244.108659:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867403648 00000100:00100000:3.0:1787380244.108663:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867403648 00000100:00100000:3.0:1787380244.108688:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787380244.108695:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867403648:12345-0@lo:41: 00000004:00000024:3.0:1787380244.108716:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1787380244.108752:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867403648:12345-0@lo:41: Request processed in 57us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380244.108758:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787380244.108821:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867403648:0@lo:41: 00000100:00100000:3.0:1787380244.109232:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867403776:0@lo:400: 00000100:00100000:3.0:1787380244.109267:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380244.109325:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867403392:12345-0@lo:13: Request processed in 873us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380244.109336:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787380244.109354:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787380244.109361:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867403520:12345-0@lo:13: 00000100:00100000:3.0:1787380244.109365:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787380244.109374:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867404160:0@lo:400: 00002000:00000024:0.0:1787380244.109375:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380244.109401:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380244.109424:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867403520:12345-0@lo:13: Request processed in 63us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380244.109432:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787380244.109433:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867403776 00000100:00100000:3.0:1787380244.109438:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867403776 00000100:00080000:0.0:1787380244.109456:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787380244.109471:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1787380244.109472:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867404032:0@lo:400: 00000100:00100000:3.0:1787380244.109481:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3640:x1874203867403776:12345-0@lo:400: 00000100:00100000:0.0:1787380244.109504:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380244.109592:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3640:x1874203867403776:12345-0@lo:400: Request processed in 112us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380244.109613:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787380244.109645:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867404160 00000100:00100000:3.0:1787380244.109649:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867404160 00000100:00100000:3.0:1787380244.109669:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787380244.109674:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867404160:12345-0@lo:400: 00000100:00100000:3.0:1787380244.109706:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867404160:12345-0@lo:400: Request processed in 31us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380244.109712:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787380244.109742:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867404160:0@lo:400: 00000100:00100000:3.0:1787380244.109751:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867403776:0@lo:400: 00000100:00100000:3.0:1787380244.109995:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1874203867404288:0@lo:400: 00000100:00100000:3.0:1787380244.110021:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380244.110090:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787380244.110096:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867404672:0@lo:400: 00000100:00100000:3.0:1787380244.110118:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380244.110143:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867404032 00000100:00100000:3.0:1787380244.110147:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867404032 00000100:00100000:3.0:1787380244.110170:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867404288 00000100:00100000:3.0:1787380244.110172:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867404288 00000100:00100000:3.0:1787380244.110191:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787380244.110197:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867404032:12345-0@lo:400: 00000100:00100000:3.0:1787380244.110223:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867404032:12345-0@lo:400: Request processed in 27us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380244.110229:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787380244.110241:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787380244.110246:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874203867404288:12345-0@lo:400: 00000100:00100000:3.0:1787380244.110278:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874203867404288:12345-0@lo:400: Request processed in 32us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380244.110284:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787380244.110301:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867404672 00000100:00100000:3.0:1787380244.110304:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867404672 00000100:00100000:3.0:1787380244.110324:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787380244.110329:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867404672:12345-0@lo:400: 00000100:00100000:3.0:1787380244.110353:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867404672:12345-0@lo:400: Request processed in 23us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380244.110358:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1787380244.110376:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787380244.110379:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787380244.110396:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff3ff8000 x1874203867404672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380244.110407:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867404672:0@lo:400: 00000100:00100000:3.0:1787380244.110415:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1874203867404288:0@lo:400: 00000100:00100000:3.0:1787380244.110577:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380244.110586:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867404800:0@lo:400: 00000100:00100000:3.0:1787380244.110609:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380244.110679:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867404032:0@lo:400: 00000100:00100000:2.0:1787380244.110690:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867404800 00000100:00100000:2.0:1787380244.110696:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867404800 00000100:00100000:0.0:1787380244.110700:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867404544:0@lo:400: 00000100:00100000:0.0:1787380244.110727:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380244.110750:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787380244.110758:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867403904:0@lo:400: 00000100:00100000:2.0:1787380244.110763:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787380244.110771:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867404800:12345-0@lo:400: 00000100:00100000:0.0:1787380244.110783:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380244.110800:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867404416:0@lo:400: 00000100:00100000:2.0:1787380244.110829:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867404800:12345-0@lo:400: Request processed in 59us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380244.110835:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787380244.110850:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867403904 00000100:00100000:2.0:1787380244.110853:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867403904 00000100:00100000:2.0:1787380244.110866:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787380244.110870:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867403904:12345-0@lo:400: 00000100:00100000:2.0:1787380244.111171:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867403904:12345-0@lo:400: Request processed in 299us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380244.111178:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787380244.111221:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867404800:0@lo:400: 00000100:00080000:3.0:1787380244.111265:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380244.111372:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380244.111423:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867404928:0@lo:400: 00000100:00100000:0.0:1787380244.111442:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380244.111600:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867403904:0@lo:400: 00000100:00100000:2.0:1787380244.111633:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867404416 00000100:00100000:2.0:1787380244.111642:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867404416 00000100:00100000:2.0:1787380244.111663:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867404928 00000100:00100000:2.0:1787380244.111665:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867404928 00000100:00100000:2.0:1787380244.111678:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787380244.111683:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867404416:12345-0@lo:400: 00000100:00100000:2.0:1787380244.111716:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867404416:12345-0@lo:400: Request processed in 32us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380244.111722:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787380244.111732:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787380244.111737:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867404928:12345-0@lo:400: 00000100:00100000:2.0:1787380244.111758:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867404928:12345-0@lo:400: Request processed in 21us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380244.111764:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1787380244.111782:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787380244.111962:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867404544 00000100:00100000:0.0:1787380244.111967:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867404544 00000100:00100000:0.0:1787380244.112037:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787380244.112044:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867404544:12345-0@lo:400: 00000100:00100000:0.0:1787380244.112074:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867404544:12345-0@lo:400: Request processed in 31us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380244.112079:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787380244.112106:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec36d5500 x1874203867403520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380244.112133:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec36d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867403520:0@lo:13: 00010000:00080000:0.0:1787380244.112146:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec36d4700 x1874203867403392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380244.112156:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec36d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867403392:0@lo:13: 00010000:00080000:0.0:1787380244.112190:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec20a4000 x1874203867404416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380244.112198:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867404416:0@lo:400: 00010000:00080000:0.0:1787380244.112206:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff3ff8000 x1874203867404928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380244.112214:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867404928:0@lo:400: 00010000:00080000:0.0:1787380244.112222:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec20a6300 x1874203867404544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380244.112230:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867404544:0@lo:400: 00000100:00080000:2.0:1787380244.112294:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1787380244.196765:0:10333:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffe3c8a0580 00000020:00000080:2.0:1787380244.196781:0:10333:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787380244.196786:0:10333:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787380244.196793:0:10333:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3c8a2810 20000000:00000080:2.0:1787380244.196799:0:10333:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d6feedd3c00 uarg=0000000000000000 20000000:01000000:2.0:1787380244.197129:0:10333:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787380244.197132:0:10333:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787380244.197135:0:10333:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787380244.197140:0:10333:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787380244.197144:0:10333:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787380244.197199:0:10333:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787380244.197202:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787380244.198537:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1787380244.199400:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1787380244.199430:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1787380244.199445:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1787380244.199465:0:10333:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787380244.199468:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787380244.200622:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1787380244.203523:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1787380244.203676:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1787380244.203700:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1787380244.203714:0:10333:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1787380244.203716:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787380244.204461:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1787380244.204666:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1787380244.204688:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1787380244.204703:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1787380244.204714:0:10333:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787380244.204717:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787380244.206219:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1787380244.206532:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1787380244.206685:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1787380244.206711:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1787380244.206723:0:10333:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787380244.206726:0:10333:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787380244.208749:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1787380244.210125:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1787380244.210157:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1787380244.210171:0:10333:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:2.0:1787380244.210185:0:10333:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787380244.210203:0:10333:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68d04 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.210344:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d7002045800/0xcf3c46fdcad68b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68b98 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.210355:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ffb89d200/0xcf3c46fdcad68bc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68bc2 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.210363:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68c08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c01 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.210381:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ffb89d400/0xcf3c46fdcad68c16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c0f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.210388:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ff5fdb000/0xcf3c46fdcad68c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c1d expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.210395:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ffb89c600/0xcf3c46fdcad68c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c39 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.210402:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c63 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.210409:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ffb89cc00/0xcf3c46fdcad68c86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68c7f expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.210416:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ff5fdb200/0xcf3c46fdcad68cb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68ca9 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.210425:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68cbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aad5 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.210431:0:10333:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ff5fdb600/0xcf3c46fdcad68cc5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aadc expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.210440:0:10333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68d04 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.210476:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ff5fdb600/0xcf3c46fdcad68cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aadc expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.210502:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6ff5fdb600/0xcf3c46fdcad68cc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aadc expref: 9 pid: 6516 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380244.210517:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867405056:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380244.210778:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68cbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aad5 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.210789:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68cbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aad5 expref: 9 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380244.210798:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867405184:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380244.211025:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ff5fdb200/0xcf3c46fdcad68cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68ca9 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.211035:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6ff5fdb200/0xcf3c46fdcad68cb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68ca9 expref: 23 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380244.211045:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867405312:0@lo:104: 00000100:00100000:2.0:1787380244.211083:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380244.211167:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ffb89cc00/0xcf3c46fdcad68c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68c7f expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.211176:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6ffb89cc00/0xcf3c46fdcad68c86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c7f expref: 23 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380244.211183:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867405440:0@lo:104: 00000100:00100000:2.0:1787380244.211203:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380244.211612:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68c63 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.211621:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68c6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c63 expref: 23 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380244.211629:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867405568:0@lo:104: 00000100:00100000:2.0:1787380244.211650:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380244.211708:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867405312 00000100:00100000:3.0:1787380244.211715:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867405312 00000100:00100000:3.0:1787380244.211764:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867405440 00000100:00100000:3.0:1787380244.211767:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867405440 00000100:00100000:3.0:1787380244.211781:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787380244.211790:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:10333:x1874203867405312:12345-0@lo:104: 00010000:00010000:3.0:1787380244.211802:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68cb0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.211878:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787380244.211885:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:10333:x1874203867405312:12345-0@lo:104: Request processed in 95us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380244.211894:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787380244.211920:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787380244.211926:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:10333:x1874203867405440:12345-0@lo:104: 00010000:00010000:3.0:1787380244.211933:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68c86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.211964:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787380244.211969:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:10333:x1874203867405440:12345-0@lo:104: Request processed in 45us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380244.211975:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1787380244.211992:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787380244.211998:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68cb0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.212004:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fda200 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380244.212008:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68cb0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.212016:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68ca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68cb0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380244.212022:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68ca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68cb0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380244.212027:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380244.212059:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68ca9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68cb0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.212066:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380244.212082:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68ca9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68cb0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.212089:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68ca9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68cb0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.212099:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380244.212102:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68c86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.212107:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c400 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380244.212110:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68c86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.212116:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68c7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68c86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380244.212122:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68c7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68c86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380244.212127:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380244.212139:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68c7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68c86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.212144:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380244.212157:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68c7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68c86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.212173:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad68c7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68c86 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.212181:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380244.212183:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380244.212184:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380244.212190:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380244.212201:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867405824:0@lo:103: 00000100:00100000:3.0:1787380244.212483:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380244.212844:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ffb89c600/0xcf3c46fdcad68c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68c39 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.212855:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6ffb89c600/0xcf3c46fdcad68c40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c39 expref: 23 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380244.212864:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867405952:0@lo:104: 00000100:00100000:2.0:1787380244.212891:0:10333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380244.212919:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ff5fdb000/0xcf3c46fdcad68c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68c1d expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.212928:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6ff5fdb000/0xcf3c46fdcad68c24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c1d expref: 23 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380244.212937:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867406080:0@lo:104: 00010000:00010000:2.0:1787380244.212977:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ffb89d400/0xcf3c46fdcad68c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68c0f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.212985:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6ffb89d400/0xcf3c46fdcad68c16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c0f expref: 23 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380244.212993:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867406208:0@lo:104: 00010000:00010000:2.0:1787380244.213025:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68c01 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.213034:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68c08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c01 expref: 23 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380244.213042:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867406336:0@lo:104: 00010000:00010000:2.0:1787380244.213062:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ffb89d200/0xcf3c46fdcad68bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68bc2 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.213070:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6ffb89d200/0xcf3c46fdcad68bc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68bc2 expref: 23 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380244.213077:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867406464:0@lo:104: 00010000:00010000:2.0:1787380244.213095:0:10333:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d7002045800/0xcf3c46fdcad68b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68b98 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.213102:0:10333:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d7002045800/0xcf3c46fdcad68b9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b98 expref: 23 pid: 6515 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380244.213110:0:10333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867406592:0@lo:104: 00000100:00100000:2.0:1787380244.213124:0:10333:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3378240 going to sleep for 11 seconds 00000100:00100000:2.0:1787380244.213143:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867405312:0@lo:104: 00000100:00100000:2.0:1787380244.213152:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867405440:0@lo:104: 00000100:00100000:3.0:1787380244.213406:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787380244.213424:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380244.213435:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380244.213443:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380244.213450:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380244.213458:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380244.213464:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867405568 00000100:00100000:3.0:1787380244.213469:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867405568 00000100:00100000:3.0:1787380244.213494:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867405952 00000100:00100000:3.0:1787380244.213498:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867405952 00000100:00100000:3.0:1787380244.213507:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867406080 00000100:00100000:3.0:1787380244.213509:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867406080 00000100:00100000:3.0:1787380244.213519:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867406208 00000100:00100000:3.0:1787380244.213521:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867406208 00000100:00100000:3.0:1787380244.213529:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867406336 00000100:00100000:3.0:1787380244.213532:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867406336 00000100:00100000:3.0:1787380244.213539:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867406464 00000100:00100000:3.0:1787380244.213541:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867406464 00000100:00100000:3.0:1787380244.213547:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867406592 00000100:00100000:3.0:1787380244.213549:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867406592 00000100:00100000:3.0:1787380244.213570:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787380244.213585:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+9:10333:x1874203867405568:12345-0@lo:104: 00010000:00010000:3.0:1787380244.213595:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68c6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.213638:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787380244.213643:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+9:10333:x1874203867405568:12345-0@lo:104: Request processed in 60us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380244.213650:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787380244.213671:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787380244.213677:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec30e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+8:10333:x1874203867405952:12345-0@lo:104: 00010000:00010000:3.0:1787380244.213684:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad68c39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68c40 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.213714:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787380244.213720:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec30e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+8:10333:x1874203867405952:12345-0@lo:104: Request processed in 44us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380244.213726:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787380244.213760:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787380244.213766:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+7:10333:x1874203867406080:12345-0@lo:104: 00010000:00010000:3.0:1787380244.213773:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89de00/0xcf3c46fdcad68c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.213803:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787380244.213828:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+7:10333:x1874203867406080:12345-0@lo:104: Request processed in 43us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380244.213834:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787380244.213849:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787380244.213861:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+6:10333:x1874203867406208:12345-0@lo:104: 00010000:00010000:3.0:1787380244.213868:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda400/0xcf3c46fdcad68c0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.213895:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787380244.213900:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+6:10333:x1874203867406208:12345-0@lo:104: Request processed in 41us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380244.213905:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787380244.213918:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787380244.213923:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:10333:x1874203867406336:12345-0@lo:104: 00010000:00010000:3.0:1787380244.213930:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdae00/0xcf3c46fdcad68c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68c08 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.213954:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1787380244.213959:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:10333:x1874203867406336:12345-0@lo:104: Request processed in 36us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380244.213964:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787380244.213977:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787380244.213983:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:10333:x1874203867406464:12345-0@lo:104: 00010000:00010000:3.0:1787380244.213989:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c200/0xcf3c46fdcad68bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68bc9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214013:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1787380244.214017:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:10333:x1874203867406464:12345-0@lo:104: Request processed in 36us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380244.214022:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787380244.214034:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787380244.214048:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:10333:x1874203867406592:12345-0@lo:104: 00010000:00010000:3.0:1787380244.214055:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad68b98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68b9f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214081:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1787380244.214086:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:10333:x1874203867406592:12345-0@lo:104: Request processed in 40us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380244.214091:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1787380244.214110:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1787380244.214114:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68c6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214120:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89da00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380244.214123:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68c6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214130:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68c63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68c6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380244.214137:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68c63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68c6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380244.214142:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380244.214169:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68c63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68c6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214177:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380244.214191:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68c63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68c6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214209:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89da00/0xcf3c46fdcad68c63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68c6a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214294:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787380244.214298:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad68c39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68c40 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214305:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89ca00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380244.214307:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad68c39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68c40 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214314:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad68c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68c40 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380244.214320:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad68c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68c40 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380244.214324:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380244.214339:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad68c39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68c40 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214345:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380244.214351:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad68c39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68c40 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214357:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad68c39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68c40 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214366:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787380244.214376:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89de00/0xcf3c46fdcad68c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214382:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89de00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380244.214384:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89de00/0xcf3c46fdcad68c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214391:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89de00/0xcf3c46fdcad68c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380244.214397:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89de00/0xcf3c46fdcad68c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380244.214402:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380244.214416:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89de00/0xcf3c46fdcad68c1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214422:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380244.214426:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89de00/0xcf3c46fdcad68c1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214432:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89de00/0xcf3c46fdcad68c1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68c24 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214442:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787380244.214445:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda400/0xcf3c46fdcad68c0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214450:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fda400 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380244.214453:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda400/0xcf3c46fdcad68c0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214470:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda400/0xcf3c46fdcad68c0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380244.214476:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda400/0xcf3c46fdcad68c0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380244.214481:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380244.214494:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda400/0xcf3c46fdcad68c0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214500:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380244.214505:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda400/0xcf3c46fdcad68c0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214510:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda400/0xcf3c46fdcad68c0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68c16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214519:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787380244.214522:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdae00/0xcf3c46fdcad68c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68c08 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214527:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdae00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380244.214529:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdae00/0xcf3c46fdcad68c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68c08 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214535:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdae00/0xcf3c46fdcad68c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68c08 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380244.214541:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdae00/0xcf3c46fdcad68c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68c08 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380244.214551:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380244.214578:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdae00/0xcf3c46fdcad68c01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68c08 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214583:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380244.214587:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdae00/0xcf3c46fdcad68c01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68c08 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214593:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdae00/0xcf3c46fdcad68c01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68c08 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214601:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787380244.214604:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c200/0xcf3c46fdcad68bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68bc9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214609:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c200 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380244.214612:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c200/0xcf3c46fdcad68bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68bc9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214619:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c200/0xcf3c46fdcad68bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68bc9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380244.214625:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c200/0xcf3c46fdcad68bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68bc9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380244.214630:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380244.214641:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c200/0xcf3c46fdcad68bc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68bc9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214647:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380244.214658:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c200/0xcf3c46fdcad68bc2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68bc9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214664:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c200/0xcf3c46fdcad68bc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68bc9 expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214673:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380244.214675:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad68b98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68b9f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214681:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d000 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380244.214683:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad68b98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68b9f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214689:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad68b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68b9f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380244.214695:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad68b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68b9f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380244.214700:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787380244.214712:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad68b98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68b9f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214718:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380244.214721:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad68b98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68b9f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214727:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad68b98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68b9f expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.214738:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380244.214745:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380244.214747:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380244.214762:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867406720:0@lo:103: 00000100:00100000:3.0:1787380244.214794:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380244.214865:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867405568:0@lo:104: 00000100:00100000:2.0:1787380244.214874:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867405952:0@lo:104: 00000100:00100000:2.0:1787380244.214881:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867406080:0@lo:104: 00000100:00100000:2.0:1787380244.214887:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867406208:0@lo:104: 00000100:00100000:2.0:1787380244.214904:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867406336:0@lo:104: 00000100:00100000:2.0:1787380244.214911:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867406464:0@lo:104: 00000100:00100000:2.0:1787380244.214918:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867406592:0@lo:104: 00010000:00010000:2.0:1787380244.215088:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380244.215095:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380244.215159:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867405696:0@lo:103: 00000100:00100000:0.0:1787380244.215191:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867406848:0@lo:103: 00000100:00100000:3.0:1787380244.215366:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867407232:0@lo:103: 00000100:00100000:3.0:1787380244.215390:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380244.215503:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867405824 00000100:00100000:1.0:1787380244.215510:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867405824 00010000:00010000:1.0:1787380244.215540:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ffb89cc00/0xcf3c46fdcad68c86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c7f expref: 24 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380244.215610:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867406720 00000100:00100000:1.0:1787380244.215615:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867406720 00010000:00010000:1.0:1787380244.215628:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68c6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c63 expref: 25 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380244.215795:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867407232 00000100:00100000:2.0:1787380244.215799:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867407232 00010000:00010000:2.0:1787380244.215836:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68c08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c01 expref: 26 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380244.215854:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787380244.215862:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+26:3639:x1874203867405824:12345-0@lo:103: 00010000:00010000:2.0:1787380244.215873:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380244.215879:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ffb89cc00/0xcf3c46fdcad68c86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c7f expref: 26 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380244.215884:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1787380244.215891:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ffb89cc00/0xcf3c46fdcad68c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c7f expref: 26 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380244.215899:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867407104:0@lo:103: 00010000:00010000:2.0:1787380244.215910:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffb89cc00/0xcf3c46fdcad68c86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68c7f expref: 26 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.215923:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380244.215957:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380244.215957:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+25:3639:x1874203867405824:12345-0@lo:103: Request processed in 95us (3473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380244.215968:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787380244.216014:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867405824:0@lo:103: 00000100:00100000:2.0:1787380244.216015:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867407104 00000100:00100000:2.0:1787380244.216021:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867407104 00010000:00010000:2.0:1787380244.216036:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ffb89d400/0xcf3c46fdcad68c16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c0f expref: 25 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380244.216058:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787380244.216064:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+25:3640:x1874203867406720:12345-0@lo:103: 00010000:00010000:2.0:1787380244.216071:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380244.216075:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68c6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c63 expref: 25 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.216083:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c63 expref: 25 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.216094:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad68c6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68c63 expref: 25 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.216102:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380244.216138:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3640:x1874203867406720:12345-0@lo:103: Request processed in 74us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380244.216145:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787380244.216157:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787380244.216162:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:3640:x1874203867407232:12345-0@lo:103: 00010000:00010000:2.0:1787380244.216169:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380244.216173:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68c08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c01 expref: 23 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.216181:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68c08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c01 expref: 23 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.216191:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68c08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68c01 expref: 23 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.216210:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380244.216309:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:3640:x1874203867407232:12345-0@lo:103: Request processed in 145us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380244.216316:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787380244.216328:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787380244.216334:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3687100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:3640:x1874203867407104:12345-0@lo:103: 00010000:00010000:2.0:1787380244.216342:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380244.216347:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ffb89d400/0xcf3c46fdcad68c16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c0f expref: 21 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.216355:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ffb89d400/0xcf3c46fdcad68c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c0f expref: 21 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.216365:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffb89d400/0xcf3c46fdcad68c16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68c0f expref: 21 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.216373:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380244.216392:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3687100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:3640:x1874203867407104:12345-0@lo:103: Request processed in 58us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380244.216397:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787380244.216459:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867407104:0@lo:103: 00000100:00100000:3.0:1787380244.216469:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867406720:0@lo:103: 00000100:00100000:3.0:1787380244.216476:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867407232:0@lo:103: 00000100:00100000:0.0:1787380244.216545:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380244.216611:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867406976:0@lo:103: 00000100:00100000:0.0:1787380244.216635:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380244.216736:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867407488:0@lo:103: 00000100:00100000:0.0:1787380244.216759:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380244.216822:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867405696 00000100:00100000:1.0:1787380244.216827:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867405696 00010000:00010000:1.0:1787380244.216846:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ff5fdb200/0xcf3c46fdcad68cb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68ca9 expref: 20 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380244.216859:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867406976 00000100:00100000:1.0:1787380244.216862:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867406976 00010000:00010000:1.0:1787380244.216871:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ff5fdb000/0xcf3c46fdcad68c24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c1d expref: 21 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380244.216882:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787380244.216888:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:3642:x1874203867405696:12345-0@lo:103: 00010000:00010000:1.0:1787380244.216902:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380244.216907:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ff5fdb200/0xcf3c46fdcad68cb0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68ca9 expref: 21 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.216915:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ff5fdb200/0xcf3c46fdcad68cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68ca9 expref: 21 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.216926:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5fdb200/0xcf3c46fdcad68cb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68ca9 expref: 21 pid: 6516 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.216935:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380244.216962:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:3642:x1874203867405696:12345-0@lo:103: Request processed in 74us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380244.216968:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787380244.216981:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787380244.216987:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:3642:x1874203867406976:12345-0@lo:103: 00010000:00010000:1.0:1787380244.216994:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380244.216998:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ff5fdb000/0xcf3c46fdcad68c24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c1d expref: 19 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.217006:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ff5fdb000/0xcf3c46fdcad68c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c1d expref: 19 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.217015:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5fdb000/0xcf3c46fdcad68c24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68c1d expref: 19 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.217022:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380244.217042:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:3642:x1874203867406976:12345-0@lo:103: Request processed in 55us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380244.217057:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787380244.217343:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867405696:0@lo:103: 00000100:00100000:0.0:1787380244.217359:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867406976:0@lo:103: 00000100:00100000:0.0:1787380244.217381:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380244.217395:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867407360:0@lo:103: 00000100:00100000:0.0:1787380244.217415:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380244.217484:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380244.217514:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380244.217635:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867407488 00000100:00100000:3.0:1787380244.217639:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867407488 00010000:00010000:3.0:1787380244.217684:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d7002045800/0xcf3c46fdcad68b9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b98 expref: 18 pid: 6515 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380244.217698:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867406848 00000100:00100000:3.0:1787380244.217701:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867406848 00010000:00010000:3.0:1787380244.217710:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ffb89c600/0xcf3c46fdcad68c40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c39 expref: 19 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380244.217720:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867407360 00000100:00100000:3.0:1787380244.217722:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867407360 00010000:00010000:3.0:1787380244.217732:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ffb89d200/0xcf3c46fdcad68bc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68bc2 expref: 20 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380244.217754:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848479360 00000100:00100000:3.0:1787380244.217757:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848479360 00010000:00010000:3.0:1787380244.217769:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ff5fdb600/0xcf3c46fdcad68cc5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aadc expref: 10 pid: 6516 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380244.217779:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848479488 00000100:00100000:3.0:1787380244.217782:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848479488 00010000:00010000:3.0:1787380244.217791:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68cbe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aad5 expref: 11 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380244.217802:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787380244.217825:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:3642:x1874203867407488:12345-0@lo:103: 00010000:00010000:3.0:1787380244.217833:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380244.217838:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d7002045800/0xcf3c46fdcad68b9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b98 expref: 20 pid: 6515 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.217846:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d7002045800/0xcf3c46fdcad68b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68b98 expref: 20 pid: 6515 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.217857:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d7002045800/0xcf3c46fdcad68b9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68b98 expref: 20 pid: 6515 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.217869:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380244.217919:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:3642:x1874203867407488:12345-0@lo:103: Request processed in 111us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380244.217925:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787380244.218149:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867407488:0@lo:103: 00000100:00100000:3.0:1787380244.218210:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787380244.218313:0:6506:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787380244.218321:0:6506:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787380244.218415:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787380244.218423:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:3641:x1874203867407360:12345-0@lo:103: 00010000:00010000:1.0:1787380244.218430:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380244.218435:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ffb89d200/0xcf3c46fdcad68bc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68bc2 expref: 18 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.218444:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ffb89d200/0xcf3c46fdcad68bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68bc2 expref: 18 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.218455:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffb89d200/0xcf3c46fdcad68bc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68bc2 expref: 18 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.218477:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380244.218508:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:3641:x1874203867407360:12345-0@lo:103: Request processed in 86us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380244.218514:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787380244.218528:0:6506:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787380244.218535:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:1.0:1787380244.218541:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2facc94b-d95a-46d6-aa1a-c4299279749f+11:2399:x1874203848479360:12345-192.168.206.30@tcp:103: 00010000:00010000:1.0:1787380244.218549:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380244.218554:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ff5fdb600/0xcf3c46fdcad68cc5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aadc expref: 11 pid: 6516 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380244.218568:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:3641:x1874203867406848:12345-0@lo:103: 00010000:00010000:1.0:1787380244.218579:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ff5fdb600/0xcf3c46fdcad68cc5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aadc expref: 11 pid: 6516 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.218586:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380244.218591:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ffb89c600/0xcf3c46fdcad68c40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c39 expref: 16 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.218598:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ffb89c600/0xcf3c46fdcad68c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68c39 expref: 16 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.218607:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffb89c600/0xcf3c46fdcad68c40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68c39 expref: 16 pid: 6513 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380244.218615:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380244.218617:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380244.218804:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2facc94b-d95a-46d6-aa1a-c4299279749f+11:2399:x1874203848479360:12345-192.168.206.30@tcp:103: Request processed in 110us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380244.218828:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:1.0:1787380244.218842:0:6506:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787380244.218849:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00100000:1.0:1787380244.218856:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2400:x1874203848479488:12345-192.168.206.30@tcp:103: 00010000:00010000:1.0:1787380244.218864:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380244.218869:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68cbe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aad5 expref: 10 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.218878:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68cbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aad5 expref: 10 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.218890:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68d04 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.218898:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68d04 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.218911:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68d04 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.218918:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68d04 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.218924:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68d04 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.218941:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68d04 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.218947:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47800 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380244.218951:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68d04 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.218960:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68d04 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.218969:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68d04 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380244.218979:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380244.219188:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5fdb600/0xcf3c46fdcad68cc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aadc expref: 10 pid: 6516 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380244.219199:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867405056:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380244.219208:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68cbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aad5 expref: 9 pid: 6513 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380244.219208:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867407360:0@lo:103: 00000100:00100000:2.0:1787380244.219217:0:10333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10333:1874203867405184:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380244.219387:0:10333:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68d04 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.219395:0:10333:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68d04 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.219401:0:10333:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68d04 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380244.219408:0:10333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68d04 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380244.220802:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:3641:x1874203867406848:12345-0@lo:103: Request processed in 2578us (3413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380244.220991:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787380244.221086:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867406848:0@lo:103: 00000100:00100000:1.0:1787380244.222651:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2facc94b-d95a-46d6-aa1a-c4299279749f+8:2400:x1874203848479488:12345-192.168.206.30@tcp:103: Request processed in 3787us (5128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380244.224207:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 34 00010000:00010000:3.0:1787380244.557684:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380244.621439:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867407616:0@lo:13: 00000100:00100000:0.0:1787380244.621506:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380244.621642:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867407616 00000100:00100000:2.0:1787380244.621650:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867407616 00000100:00100000:2.0:1787380244.621700:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787380244.621709:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867407616:12345-0@lo:13: 00002000:00000024:2.0:1787380244.621734:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380244.621782:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867407616:12345-0@lo:13: Request processed in 74us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380244.621789:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787380244.621845:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec336dc00 x1874203867407616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380244.621862:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867407616:0@lo:13: 00000100:00100000:1.0:1787380244.626757:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867407744:0@lo:13: 00000100:00100000:1.0:1787380244.626837:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380244.627028:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867407744 00000100:00100000:2.0:1787380244.627045:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867407744 00000100:00100000:2.0:1787380244.627094:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787380244.627104:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867407744:12345-0@lo:13: 00002000:00000024:2.0:1787380244.627125:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380244.627347:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867407744:12345-0@lo:13: Request processed in 244us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380244.627354:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787380244.627432:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec336dc00 x1874203867407744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380244.627450:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867407744:0@lo:13: 00000100:00100000:0.0:1787380245.087373:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380245.087522:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848479616 00000100:00100000:3.0:1787380245.087531:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848479616 00000100:00100000:3.0:1787380245.087595:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 200 00000100:00100000:3.0:1787380245.087605:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+8:6169:x1874203848479616:12345-192.168.206.30@tcp:101: 00010000:00010000:3.0:1787380245.087619:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380245.087637:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5fdae00/0xcf3c46fdcad68d0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ab4c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380245.087672:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5fdae00/0xcf3c46fdcad68d0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab4c expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380245.087683:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5fdae00/0xcf3c46fdcad68d0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab4c expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380245.087709:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fdae00, rc 0) 00000100:00100000:3.0:1787380245.087766:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+9:6169:x1874203848479616:12345-192.168.206.30@tcp:101: Request processed in 162us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.087773:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 200 00000100:00100000:0.0:1787380245.092409:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380245.092489:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848479744 00000100:00100000:3.0:1787380245.092498:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848479744 00000100:00100000:3.0:1787380245.092565:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 201 00000100:00100000:3.0:1787380245.092575:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+9:6169:x1874203848479744:12345-192.168.206.30@tcp:501: 00000100:00100000:3.0:1787380245.092740:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+9:6169:x1874203848479744:12345-192.168.206.30@tcp:501: Request processed in 167us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.092748:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 201 00000100:00100000:1.0:1787380245.095939:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380245.096077:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848479872 00000100:00100000:0.0:1787380245.096086:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848479872 00000100:00100000:0.0:1787380245.096144:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 202 00000100:00100000:0.0:1787380245.096161:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+9:6169:x1874203848479872:12345-192.168.206.30@tcp:503: 00000100:00100000:0.0:1787380245.096293:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+9:6169:x1874203848479872:12345-192.168.206.30@tcp:503: Request processed in 132us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.096301:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 202 00000100:00100000:1.0:1787380245.102441:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380245.103967:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848480000 00000100:00100000:0.0:1787380245.103979:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848480000 00000100:00100000:0.0:1787380245.104045:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 203 00000100:00100000:0.0:1787380245.104055:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+9:6643:x1874203848480000:12345-192.168.206.30@tcp:502: 00000100:00100000:0.0:1787380245.104346:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+9:6643:x1874203848480000:12345-192.168.206.30@tcp:502: Request processed in 292us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.104361:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 203 00000100:00100000:2.0:1787380245.106863:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380245.114953:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848480128 00000100:00100000:3.0:1787380245.114967:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848480128 00000100:00100000:3.0:1787380245.115024:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 204 00000100:00100000:3.0:1787380245.115046:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+9:6643:x1874203848480128:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787380245.115202:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+9:6643:x1874203848480128:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 169us (8440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.115210:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 204 00000100:00100000:1.0:1787380245.134623:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380245.135397:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848480256 00000100:00100000:0.0:1787380245.135407:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848480256 00000100:00100000:0.0:1787380245.135470:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 205 00000100:00100000:0.0:1787380245.135480:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+9:6169:x1874203848480256:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380245.135495:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380245.135521:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad68d12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ab53 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.135548:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad68d12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab53 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.135570:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad68d12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab53 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.135579:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9a000, rc 0) 00000100:00100000:0.0:1787380245.135636:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6169:x1874203848480256:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 Request processed in 158us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.135644:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 205 00000100:00100000:1.0:1787380245.144256:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380245.144789:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848480384 00000100:00100000:0.0:1787380245.144798:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848480384 00000100:00100000:0.0:1787380245.144887:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 206 00000100:00100000:0.0:1787380245.144895:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6169:x1874203848480384:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380245.145016:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6169:x1874203848480384:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 Request processed in 122us (770us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787380245.145023:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 206 10000000:01000000:1.0:1787380245.325580:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787380245.325603:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6fff5a3000 from 48 10000000:01000000:1.0:1787380245.325609:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787380245.325654:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68d19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380245.325665:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68d19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380245.325675:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68d19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380245.325697:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867407872:0@lo:101: 00000100:00100000:1.0:1787380245.325759:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380245.325839:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd63760c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380245.327514:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867407872 00000100:00100000:0.0:1787380245.327524:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867407872 00000100:00100000:0.0:1787380245.327596:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787380245.327605:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+15:6518:x1874203867407872:12345-0@lo:101: 00010000:00010000:0.0:1787380245.327619:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380245.327635:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68d20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68d19 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.327658:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68d20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68d19 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.327667:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68d20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68d19 expref: 16 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.327675:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9b800, rc 0) 00000100:00100000:0.0:1787380245.327733:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867407872:12345-0@lo:101: Request processed in 130us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.327739:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1787380245.330595:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867407872:0@lo:101: 00010000:00010000:1.0:1787380245.330623:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68d19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380245.330634:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68d19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68d20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380245.330715:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867408000:0@lo:501: 00000100:00100000:1.0:1787380245.330765:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380245.332245:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd63760c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380245.332342:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867408000 00000100:00100000:3.0:1787380245.332350:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867408000 00000100:00100000:3.0:1787380245.332412:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1787380245.332481:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867408000:12345-0@lo:501: 00000100:00100000:3.0:1787380245.332636:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867408000:12345-0@lo:501: Request processed in 215us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.332660:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787380245.332755:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867408000:0@lo:501: 00000100:00100000:1.0:1787380245.332796:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867408128:0@lo:503: 00000100:00100000:1.0:1787380245.332940:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380245.332966:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd63760c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380245.333135:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867408128 00000100:00100000:3.0:1787380245.333140:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867408128 00000100:00100000:3.0:1787380245.333214:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1787380245.333221:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867408128:12345-0@lo:503: 00000100:00100000:3.0:1787380245.333306:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867408128:12345-0@lo:503: Request processed in 85us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.333313:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1787380245.334678:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867408128:0@lo:503: 00000100:00100000:2.0:1787380245.342302:0:10351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10351:1874203867408256:0@lo:502: 00000100:00100000:2.0:1787380245.342390:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380245.342437:0:10351:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3378e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787380245.344657:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867408256 00000100:00100000:1.0:1787380245.344669:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867408256 00000100:00100000:1.0:1787380245.344734:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1787380245.344743:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:10351:x1874203867408256:12345-0@lo:502: 00000100:00100000:1.0:1787380245.344966:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:10351:x1874203867408256:12345-0@lo:502: Request processed in 223us (2575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380245.344974:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1787380245.345572:0:10351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10351:1874203867408256:0@lo:502: 00000100:00100000:2.0:1787380245.345635:0:10351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10351:1874203867408384:0@lo:502: 00000100:00100000:2.0:1787380245.345684:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380245.345725:0:10351:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3378e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787380245.345846:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867408384 00000100:00100000:0.0:1787380245.345852:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867408384 00000100:00100000:0.0:1787380245.345897:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1787380245.345904:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:10351:x1874203867408384:12345-0@lo:502: 00000100:00100000:0.0:1787380245.346002:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:10351:x1874203867408384:12345-0@lo:502: Request processed in 98us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380245.346277:0:10351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10351:1874203867408384:0@lo:502: 00000040:00080000:2.0:1787380245.346296:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:0.0:1787380245.346442:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000020:01000000:1.0:1787380245.346695:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1787380245.346717:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787380245.346727:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68d19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380245.346738:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68d19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380245.346747:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787380245.346750:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787380245.346752:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787380245.346785:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68d27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380245.346794:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68d27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380245.346843:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68d27 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380245.346859:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867408512:0@lo:101: 00000100:00100000:1.0:1787380245.347207:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380245.347230:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd6376cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380245.347291:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867408512 00000100:00100000:0.0:1787380245.347296:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867408512 00000100:00100000:0.0:1787380245.347328:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1787380245.347335:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+16:6518:x1874203867408512:12345-0@lo:101: 00010000:00010000:0.0:1787380245.347350:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380245.347360:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68d2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68d27 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.347379:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68d2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68d27 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.347389:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68d2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68d27 expref: 17 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.347397:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9ae00, rc 0) 00000100:00100000:0.0:1787380245.347434:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867408512:12345-0@lo:101: Request processed in 99us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.347440:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787380245.347698:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867408512:0@lo:101: 00010000:00010000:1.0:1787380245.347712:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68d27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d2e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380245.347720:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68d27 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68d2e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380245.347773:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867408640:0@lo:501: 00000100:00100000:1.0:1787380245.347845:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380245.347869:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd6376cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380245.348232:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867408640 00000100:00100000:0.0:1787380245.348237:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867408640 00000100:00100000:0.0:1787380245.348270:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1787380245.348278:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867408640:12345-0@lo:501: 00000100:00100000:0.0:1787380245.348383:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867408640:12345-0@lo:501: Request processed in 106us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.348389:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1787380245.348500:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867408640:0@lo:501: 00000100:00100000:1.0:1787380245.348542:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867408768:0@lo:503: 00000100:00100000:1.0:1787380245.348594:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380245.348616:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd6376cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380245.348716:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867408768 00000100:00100000:2.0:1787380245.348720:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867408768 00000100:00100000:2.0:1787380245.348754:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787380245.348761:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867408768:12345-0@lo:503: 00000100:00100000:2.0:1787380245.348889:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867408768:12345-0@lo:503: Request processed in 116us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380245.348897:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1787380245.349161:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867408768:0@lo:503: 00000100:00100000:1.0:1787380245.349790:0:10352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10352:1874203867408896:0@lo:502: 00000100:00100000:1.0:1787380245.349858:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380245.349889:0:10352:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd63763c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380245.350163:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867408896 00000100:00100000:2.0:1787380245.350168:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867408896 00000100:00100000:2.0:1787380245.350191:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787380245.350197:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:10352:x1874203867408896:12345-0@lo:502: 00000100:00100000:2.0:1787380245.350282:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:10352:x1874203867408896:12345-0@lo:502: Request processed in 84us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380245.350294:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1787380245.350390:0:10352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10352:1874203867408896:0@lo:502: 00000020:01000000:1.0:1787380245.350412:0:10352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380245.350419:0:10352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380245.350421:0:10352:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787380245.350426:0:10352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787380245.350446:0:10352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10352:1874203867409024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380245.350475:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380245.350502:0:10352:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd63763c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380245.350596:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867409024 00000100:00100000:3.0:1787380245.350600:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867409024 00000100:00100000:3.0:1787380245.350628:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787380245.350635:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:10352:x1874203867409024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380245.350695:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:10352:x1874203867409024:12345-0@lo:502:llog_process_th.0 Request processed in 60us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.350701:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1787380245.350794:0:10352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10352:1874203867409024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787380245.350836:0:10352:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380245.350840:0:10352:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380245.350841:0:10352:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787380245.350844:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1787380245.351218:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787380245.351236:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787380245.351245:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68d27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d2e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.351255:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68d27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d2e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380245.351273:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787380245.351276:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6ff5cad800 from 48 10000000:01000000:0.0:1787380245.351278:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787380245.351299:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68d35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.351306:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68d35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.351314:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68d35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380245.351327:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec36d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867409152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787380245.351357:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380245.351384:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd155e300 going to sleep for 11 seconds 00000100:00100000:3.0:1787380245.351432:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867409152 00000100:00100000:3.0:1787380245.351438:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867409152 00000100:00100000:3.0:1787380245.351467:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787380245.351473:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+17:6518:x1874203867409152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380245.351481:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380245.351493:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5fda400/0xcf3c46fdcad68d3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68d35 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380245.351521:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5fda400/0xcf3c46fdcad68d3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68d35 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380245.351530:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5fda400/0xcf3c46fdcad68d3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68d35 expref: 18 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380245.351543:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fda400, rc 0) 00000100:00100000:3.0:1787380245.351587:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867409152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.351592:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1787380245.352152:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec36d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867409152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380245.352165:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68d35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d3c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380245.352173:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68d35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68d3c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380245.352222:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867409280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380245.352253:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380245.352275:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd63763c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380245.352497:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867409280 00000100:00100000:3.0:1787380245.352503:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867409280 00000100:00100000:3.0:1787380245.352547:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787380245.352565:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867409280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380245.352703:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867409280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.352709:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1787380245.354729:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867409280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380245.354800:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867409408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380245.354906:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380245.355197:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867409408 00000100:00100000:0.0:1787380245.355205:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867409408 00000100:00100000:0.0:1787380245.355258:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787380245.355267:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867409408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380245.355377:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867409408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.355385:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787380245.355795:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd63763c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380245.356234:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867409408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380245.357241:0:10353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3687100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10353:1874203867409536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380245.357307:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380245.357346:0:10353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787380245.357966:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867409536 00000100:00100000:0.0:1787380245.357974:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867409536 00000100:00100000:0.0:1787380245.358015:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787380245.358022:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:10353:x1874203867409536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380245.358160:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:10353:x1874203867409536:12345-0@lo:502:llog_process_th.0 Request processed in 137us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.358173:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787380245.358681:0:10353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3687100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10353:1874203867409536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380245.358736:0:10353:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10353:1874203867409664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380245.358791:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380245.358853:0:10353:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3378240 going to sleep for 11 seconds 00000100:00100000:3.0:1787380245.358909:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867409664 00000100:00100000:3.0:1787380245.358914:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867409664 00000100:00100000:3.0:1787380245.358951:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787380245.358958:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:10353:x1874203867409664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380245.359067:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:10353:x1874203867409664:12345-0@lo:502:llog_process_th.0 Request processed in 108us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.359074:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787380245.359364:0:10353:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10353:1874203867409664:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787380245.359384:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787380245.359832:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787380245.359858:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787380245.359867:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68d35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d3c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380245.359899:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68d35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d3c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380245.359909:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787380245.359912:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787380245.359915:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787380245.359948:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68d43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380245.359957:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68d43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380245.359966:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68d43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380245.359981:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3684380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867409792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787380245.360015:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380245.360038:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc85769c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380245.360147:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867409792 00000100:00100000:0.0:1787380245.360152:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867409792 00000100:00100000:0.0:1787380245.360182:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787380245.360190:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+18:6518:x1874203867409792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380245.360199:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380245.360211:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9a400/0xcf3c46fdcad68d4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68d43 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.360229:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9a400/0xcf3c46fdcad68d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68d43 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.360238:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9a400/0xcf3c46fdcad68d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68d43 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.360246:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9a400, rc 0) 00000100:00100000:0.0:1787380245.360275:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:6518:x1874203867409792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.360281:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1787380245.360614:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3684380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867409792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380245.360627:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68d43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d4a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380245.360635:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68d43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68d4a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380245.360682:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3684380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867409920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380245.360707:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380245.360735:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc85769c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380245.360783:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867409920 00000100:00100000:0.0:1787380245.360787:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867409920 00000100:00100000:0.0:1787380245.360844:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787380245.360852:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:6518:x1874203867409920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380245.360973:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:6518:x1874203867409920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.360981:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787380245.361426:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3684380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867409920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380245.361459:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867410048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380245.361501:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380245.361540:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3378240 going to sleep for 11 seconds 00000100:00100000:0.0:1787380245.362103:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867410048 00000100:00100000:0.0:1787380245.362116:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867410048 00000100:00100000:0.0:1787380245.362147:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787380245.362154:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:6518:x1874203867410048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380245.362245:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:6518:x1874203867410048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.362252:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787380245.362423:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867410048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380245.363312:0:10354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10354:1874203867410176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380245.363374:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380245.363409:0:10354:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc85769c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380245.363589:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867410176 00000100:00100000:0.0:1787380245.363595:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867410176 00000100:00100000:0.0:1787380245.363637:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787380245.363645:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:10354:x1874203867410176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380245.363757:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:10354:x1874203867410176:12345-0@lo:502:llog_process_th.0 Request processed in 112us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.363764:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787380245.364386:0:10354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10354:1874203867410176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787380245.364412:0:10354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380245.364419:0:10354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380245.364421:0:10354:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787380245.364426:0:10354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787380245.364447:0:10354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10354:1874203867410304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380245.364480:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380245.364515:0:10354:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc85769c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380245.364615:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867410304 00000100:00100000:0.0:1787380245.364620:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867410304 00000100:00100000:0.0:1787380245.364649:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787380245.364655:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:10354:x1874203867410304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380245.364726:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:10354:x1874203867410304:12345-0@lo:502:llog_process_th.0 Request processed in 71us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.364732:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787380245.364982:0:10354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10354:1874203867410304:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787380245.365001:0:10354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380245.365005:0:10354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380245.365007:0:10354:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787380245.365010:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1787380245.365793:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787380245.365864:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787380245.365874:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68d43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d4a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380245.365886:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68d43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d4a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380245.365895:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787380245.365898:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6ff3dad800 from 48 10000000:01000000:2.0:1787380245.365901:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787380245.365928:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46a00/0xcf3c46fdcad68d51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380245.365946:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46a00/0xcf3c46fdcad68d51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380245.365955:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46a00/0xcf3c46fdcad68d51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380245.365974:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867410432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787380245.366017:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380245.366053:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3378240 going to sleep for 11 seconds 00000100:00100000:0.0:1787380245.366321:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867410432 00000100:00100000:0.0:1787380245.366327:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867410432 00000100:00100000:0.0:1787380245.366402:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787380245.366411:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:6518:x1874203867410432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380245.366422:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380245.366435:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9a600/0xcf3c46fdcad68d58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68d51 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.366467:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9a600/0xcf3c46fdcad68d58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68d51 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.366478:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9a600/0xcf3c46fdcad68d58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68d51 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.366485:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9a600, rc 0) 00000100:00100000:0.0:1787380245.366526:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867410432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.366533:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787380245.366605:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867410432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380245.366617:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46a00/0xcf3c46fdcad68d51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d58 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380245.366626:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46a00/0xcf3c46fdcad68d51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68d58 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380245.366673:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867410560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380245.366700:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380245.366776:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3378240 going to sleep for 11 seconds 00000100:00100000:3.0:1787380245.366865:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867410560 00000100:00100000:3.0:1787380245.366870:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867410560 00000100:00100000:3.0:1787380245.366893:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787380245.366899:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867410560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380245.367013:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867410560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.367020:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787380245.367390:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867410560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380245.367418:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867410688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380245.367455:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380245.367515:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3378240 going to sleep for 11 seconds 00000100:00100000:3.0:1787380245.367543:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867410688 00000100:00100000:3.0:1787380245.367547:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867410688 00000100:00100000:3.0:1787380245.367622:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787380245.367630:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867410688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380245.367755:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867410688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.367763:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787380245.367964:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867410688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380245.368329:0:10355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10355:1874203867410816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380245.368369:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380245.368431:0:10355:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd63763c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380245.368469:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867410816 00000100:00100000:2.0:1787380245.368479:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867410816 00000100:00100000:2.0:1787380245.368545:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787380245.368563:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:10355:x1874203867410816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380245.368665:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:10355:x1874203867410816:12345-0@lo:502:llog_process_th.0 Request processed in 112us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380245.368671:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787380245.368740:0:10355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10355:1874203867410816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380245.368777:0:10355:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10355:1874203867410944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380245.368844:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380245.369037:0:10355:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd63763c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380245.369094:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867410944 00000100:00100000:0.0:1787380245.369098:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867410944 00000100:00100000:0.0:1787380245.369120:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787380245.369127:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:10355:x1874203867410944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380245.369242:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:10355:x1874203867410944:12345-0@lo:502:llog_process_th.0 Request processed in 114us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.369249:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787380245.369340:0:10355:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10355:1874203867410944:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787380245.369360:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787380245.369536:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1787380245.370042:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787380245.370052:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46a00/0xcf3c46fdcad68d51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d58 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380245.370063:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46a00/0xcf3c46fdcad68d51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d58 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380245.370071:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1787380245.370074:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1787380245.370076:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787380245.370101:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47400/0xcf3c46fdcad68d5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380245.370109:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47400/0xcf3c46fdcad68d5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380245.370119:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47400/0xcf3c46fdcad68d5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380245.370139:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867411072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787380245.370174:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380245.370240:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3378840 going to sleep for 11 seconds 00000100:00100000:0.0:1787380245.370279:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867411072 00000100:00100000:0.0:1787380245.370284:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867411072 00000100:00100000:0.0:1787380245.370342:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787380245.370350:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867411072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380245.370360:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380245.370372:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9b400/0xcf3c46fdcad68d66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68d5f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.370393:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9b400/0xcf3c46fdcad68d66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68d5f expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.370409:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9b400/0xcf3c46fdcad68d66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68d5f expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.370416:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9b400, rc 0) 00000100:00100000:0.0:1787380245.370491:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867411072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.370497:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787380245.370544:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867411072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380245.370568:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47400/0xcf3c46fdcad68d5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d66 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380245.370578:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47400/0xcf3c46fdcad68d5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68d66 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380245.370628:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867411200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380245.370653:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380245.370740:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380245.370945:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867411200 00000100:00100000:2.0:1787380245.370949:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867411200 00000100:00100000:2.0:1787380245.370971:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787380245.370976:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867411200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380245.371083:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867411200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380245.371090:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787380245.371151:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867411200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380245.371178:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867411328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380245.371217:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380245.371243:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380245.371280:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867411328 00000100:00100000:2.0:1787380245.371284:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867411328 00000100:00100000:2.0:1787380245.371301:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787380245.371307:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867411328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380245.371383:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867411328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380245.371390:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787380245.371457:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867411328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380245.371802:0:10356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10356:1874203867411456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380245.371863:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380245.371878:0:10356:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576840 going to sleep for 11 seconds 00000100:00100000:2.0:1787380245.371931:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867411456 00000100:00100000:2.0:1787380245.371936:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867411456 00000100:00100000:2.0:1787380245.371953:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787380245.371959:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:10356:x1874203867411456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380245.372033:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:10356:x1874203867411456:12345-0@lo:502:llog_process_th.0 Request processed in 73us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380245.372039:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787380245.372163:0:10356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10356:1874203867411456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787380245.372184:0:10356:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380245.372192:0:10356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380245.372199:0:10356:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787380245.372206:0:10356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787380245.372224:0:10356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10356:1874203867411584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380245.372257:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380245.372284:0:10356:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576840 going to sleep for 11 seconds 00000100:00100000:2.0:1787380245.372324:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867411584 00000100:00100000:2.0:1787380245.372328:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867411584 00000100:00100000:2.0:1787380245.372345:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787380245.372351:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:10356:x1874203867411584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380245.372418:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:10356:x1874203867411584:12345-0@lo:502:llog_process_th.0 Request processed in 66us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380245.372430:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787380245.372493:0:10356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10356:1874203867411584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787380245.372510:0:10356:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380245.372514:0:10356:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380245.372515:0:10356:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787380245.372519:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1787380245.372672:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1787380245.372690:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1787380245.372700:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47400/0xcf3c46fdcad68d5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d66 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380245.372709:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47400/0xcf3c46fdcad68d5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d66 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380245.372717:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787380245.372720:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6fc873b000 from 48 10000000:01000000:2.0:1787380245.372722:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787380245.372745:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46000/0xcf3c46fdcad68d6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380245.372753:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46000/0xcf3c46fdcad68d6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380245.372762:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46000/0xcf3c46fdcad68d6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380245.372773:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867411712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787380245.372799:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380245.372858:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec33786c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380245.372967:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867411712 00000100:00100000:3.0:1787380245.372972:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867411712 00000100:00100000:3.0:1787380245.372990:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787380245.372995:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867411712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380245.373002:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380245.373013:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5fdac00/0xcf3c46fdcad68d74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68d6d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380245.373031:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5fdac00/0xcf3c46fdcad68d74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68d6d expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380245.373041:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5fdac00/0xcf3c46fdcad68d74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68d6d expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380245.373049:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fdac00, rc 0) 00000100:00100000:3.0:1787380245.373076:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867411712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.373082:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787380245.373155:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867411712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380245.373166:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46000/0xcf3c46fdcad68d6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380245.373184:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46000/0xcf3c46fdcad68d6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380245.373226:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867411840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380245.373249:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380245.373269:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec33786c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380245.373310:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867411840 00000100:00100000:3.0:1787380245.373321:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867411840 00000100:00100000:3.0:1787380245.373339:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787380245.373344:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867411840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380245.373434:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867411840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.373441:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787380245.373571:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867411840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380245.373597:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867411968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380245.373632:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380245.373653:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec33786c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380245.373692:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867411968 00000100:00100000:3.0:1787380245.373696:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867411968 00000100:00100000:3.0:1787380245.373725:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787380245.373731:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867411968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380245.373832:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867411968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.373839:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787380245.374027:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867411968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380245.374451:0:10357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10357:1874203867412096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380245.374487:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380245.374516:0:10357:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3378d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380245.374566:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867412096 00000100:00100000:3.0:1787380245.374571:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867412096 00000100:00100000:3.0:1787380245.374599:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787380245.374606:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:10357:x1874203867412096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380245.374691:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:10357:x1874203867412096:12345-0@lo:502:llog_process_th.0 Request processed in 84us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.374697:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787380245.375075:0:10357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10357:1874203867412096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380245.375114:0:10357:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10357:1874203867412224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380245.375149:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380245.375175:0:10357:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3378d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380245.375219:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867412224 00000100:00100000:3.0:1787380245.375222:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867412224 00000100:00100000:3.0:1787380245.375244:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787380245.375250:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:10357:x1874203867412224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380245.375326:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:10357:x1874203867412224:12345-0@lo:502:llog_process_th.0 Request processed in 75us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.375343:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787380245.375410:0:10357:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10357:1874203867412224:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787380245.375429:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787380245.375574:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1787380245.375590:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787380245.375597:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46000/0xcf3c46fdcad68d6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380245.375606:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46000/0xcf3c46fdcad68d6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380245.375616:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787380245.375618:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1787380245.375620:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787380245.375641:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdb800/0xcf3c46fdcad68d7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380245.375648:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdb800/0xcf3c46fdcad68d7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380245.375656:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdb800/0xcf3c46fdcad68d7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380245.375669:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867412352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787380245.375696:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380245.375718:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd0019f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380245.375770:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867412352 00000100:00100000:0.0:1787380245.375775:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867412352 00000100:00100000:0.0:1787380245.375794:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787380245.375800:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867412352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380245.375920:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380245.375944:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7866c00/0xcf3c46fdcad68d82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68d7b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.375964:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7866c00/0xcf3c46fdcad68d82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68d7b expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.375973:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7866c00/0xcf3c46fdcad68d82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68d7b expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.375981:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866c00, rc 0) 00000100:00100000:0.0:1787380245.376021:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867412352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.376027:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787380245.376096:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867412352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380245.376109:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdb800/0xcf3c46fdcad68d7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380245.376126:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdb800/0xcf3c46fdcad68d7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68d82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380245.376171:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867412480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380245.376196:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380245.376217:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd0019f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787380245.376275:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867412480 00000100:00100000:2.0:1787380245.376279:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867412480 00000100:00100000:2.0:1787380245.376297:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787380245.376309:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867412480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380245.376410:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867412480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380245.376416:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787380245.376476:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867412480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380245.376499:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867412608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380245.376538:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380245.376576:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd0019f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380245.376618:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867412608 00000100:00100000:0.0:1787380245.376622:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867412608 00000100:00100000:0.0:1787380245.376643:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787380245.376648:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867412608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380245.376720:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867412608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.376727:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787380245.376795:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867412608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380245.377270:0:10358:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10358:1874203867412736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380245.377319:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380245.377346:0:10358:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd00196c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380245.377631:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867412736 00000100:00100000:0.0:1787380245.377638:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867412736 00000100:00100000:0.0:1787380245.377674:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787380245.377682:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:10358:x1874203867412736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380245.377774:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:10358:x1874203867412736:12345-0@lo:502:llog_process_th.0 Request processed in 92us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.377780:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787380245.377955:0:10358:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10358:1874203867412736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787380245.377979:0:10358:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380245.377986:0:10358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380245.377988:0:10358:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787380245.377994:0:10358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787380245.378014:0:10358:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10358:1874203867412864:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380245.378047:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380245.378062:0:10358:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576180 going to sleep for 11 seconds 00000100:00100000:1.0:1787380245.378114:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867412864 00000100:00100000:1.0:1787380245.378119:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867412864 00000100:00100000:1.0:1787380245.378153:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787380245.378160:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:10358:x1874203867412864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380245.378240:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:10358:x1874203867412864:12345-0@lo:502:llog_process_th.0 Request processed in 80us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380245.378247:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787380245.378399:0:10358:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10358:1874203867412864:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787380245.378424:0:10358:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380245.378428:0:10358:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380245.378430:0:10358:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787380245.378434:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1787380245.378599:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:2.0:1787380245.378620:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787380245.378630:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdb800/0xcf3c46fdcad68d7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380245.378641:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdb800/0xcf3c46fdcad68d7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380245.378651:0:6518:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787380245.378653:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9d6ff8828000 from 1 10000000:01000000:2.0:1787380245.378656:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787380245.378679:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46e00/0xcf3c46fdcad68d89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380245.378688:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46e00/0xcf3c46fdcad68d89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380245.378697:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46e00/0xcf3c46fdcad68d89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380245.378711:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867412992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787380245.378740:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380245.378763:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec33780c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380245.378803:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867412992 00000100:00100000:1.0:1787380245.379046:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867412992 00000100:00100000:0.0:1787380245.379129:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787380245.379136:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867412992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380245.379145:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380245.379156:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7867e00/0xcf3c46fdcad68d90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68d89 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.379174:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7867e00/0xcf3c46fdcad68d90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68d89 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.379183:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7867e00/0xcf3c46fdcad68d90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68d89 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380245.379191:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867e00, rc 0) 00000100:00100000:0.0:1787380245.379267:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:6518:x1874203867412992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380245.379282:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787380245.379395:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867412992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380245.379408:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46e00/0xcf3c46fdcad68d89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d90 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380245.379417:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46e00/0xcf3c46fdcad68d89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68d90 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380245.379464:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867413120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380245.379492:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380245.379548:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd6376e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787380245.379588:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867413120 00000100:00100000:2.0:1787380245.379593:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867413120 00000100:00100000:2.0:1787380245.379669:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787380245.379677:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:6518:x1874203867413120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380245.379753:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:6518:x1874203867413120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (259us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787380245.379759:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787380245.379873:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867413120:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787380245.380209:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787380245.380216:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46e00/0xcf3c46fdcad68d89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d90 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380245.380230:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46e00/0xcf3c46fdcad68d89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d90 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380245.579993:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380245.646486:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec36d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867413248:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787380245.646567:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380245.646844:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867413248 00000100:00100000:1.0:1787380245.646853:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867413248 00000100:00100000:1.0:1787380245.646903:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787380245.646913:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867413248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380245.646944:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380245.647759:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867413248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 843us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380245.647769:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787380245.648089:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec36d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867413248:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787380245.662328:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380245.662366:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380245.662381:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380245.662417:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380245.662481:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848480640 00000100:00100000:3.0:1787380245.662490:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848480640 00000100:00100000:3.0:1787380245.662545:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848480512 00000100:00100000:3.0:1787380245.662548:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848480512 00000100:00100000:3.0:1787380245.662581:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 65 00000100:00100000:3.0:1787380245.662590:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848480640:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380245.662650:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848480640:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 61us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.662657:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 65 00000100:00100000:3.0:1787380245.662678:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00100000:3.0:1787380245.662684:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2400:x1874203848480512:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380245.662708:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2400:x1874203848480512:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 24us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.662714:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00100000:3.0:1787380245.662732:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848480896 00000100:00100000:3.0:1787380245.662735:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848480896 00000100:00100000:3.0:1787380245.662758:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848480768 00000100:00100000:3.0:1787380245.662761:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848480768 00000100:00100000:3.0:1787380245.662780:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:3.0:1787380245.662786:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848480896:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380245.662847:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848480896:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 60us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.662855:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:3.0:1787380245.662868:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:3.0:1787380245.662875:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848480768:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380245.662896:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848480768:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 22us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380245.662901:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00080000:0.0:1787380245.663061:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787380245.663065:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380245.663067:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787380245.663069:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:3.0:1787380246.178947:0:10395:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffefa8693a0 00000020:00000080:3.0:1787380246.178961:0:10395:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787380246.178965:0:10395:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787380246.178972:0:10395:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffefa86b630 20000000:00000080:3.0:1787380246.178979:0:10395:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d6ec34f9800 uarg=0000000000000000 20000000:01000000:3.0:1787380246.179024:0:10395:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787380246.179029:0:10395:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787380246.179033:0:10395:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787380246.182012:0:10397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787380246.182173:0:10395:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787380246.194693:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787380246.194730:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787380246.194745:0:10395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787380246.194758:0:10395:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787380246.194777:0:10395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad68d97 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380246.194794:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe0a9a800/0xcf3c46fdcad68a33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a2c expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380246.194803:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe0a9be00/0xcf3c46fdcad68a41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a3a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380246.194839:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe0a9aa00/0xcf3c46fdcad68a95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68a8e expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380246.194846:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d7002045e00/0xcf3c46fdcad68bbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68bb4 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380246.194866:0:10395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68cd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab14 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380246.194875:0:10395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad68d97 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380246.194909:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68cd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab14 expref: 9 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380246.194923:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68cd3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab14 expref: 9 pid: 6515 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380246.194937:0:10395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874203867413376:192.168.206.30@tcp:104: 00010000:00010000:1.0:1787380246.195035:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d7002045e00/0xcf3c46fdcad68bbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68bb4 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380246.195044:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d7002045e00/0xcf3c46fdcad68bbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68bb4 expref: 23 pid: 6513 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380246.195054:0:10395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874203867413504:0@lo:104: 00000100:00100000:1.0:1787380246.195102:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787380246.195145:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe0a9aa00/0xcf3c46fdcad68a95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68a8e expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380246.195153:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fe0a9aa00/0xcf3c46fdcad68a95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a8e expref: 23 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380246.195161:0:10395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874203867413632:0@lo:104: 00000100:00100000:1.0:1787380246.195199:0:10395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787380246.195226:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe0a9be00/0xcf3c46fdcad68a41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68a3a expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380246.195233:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fe0a9be00/0xcf3c46fdcad68a41 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a3a expref: 23 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380246.195240:0:10395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874203867413760:0@lo:104: 00010000:00010000:1.0:1787380246.195259:0:10395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe0a9a800/0xcf3c46fdcad68a33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68a2c expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380246.195267:0:10395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fe0a9a800/0xcf3c46fdcad68a33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a2c expref: 23 pid: 6515 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380246.195275:0:10395:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874203867413888:0@lo:104: 00000100:00100000:1.0:1787380246.195294:0:10395:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd6376d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380246.195414:0:6504:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787380246.195431:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380246.195451:0:6504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380246.195459:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867413504 00000100:00100000:2.0:1787380246.195465:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867413504 00000100:00100000:2.0:1787380246.195500:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867413632 00000100:00100000:2.0:1787380246.195503:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867413632 00000100:00100000:2.0:1787380246.195514:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867413760 00000100:00100000:2.0:1787380246.195516:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867413760 00000100:00100000:2.0:1787380246.195524:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867413888 00000100:00100000:2.0:1787380246.195526:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867413888 00000100:00100000:2.0:1787380246.195536:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787380246.195543:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3699500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+6:10395:x1874203867413504:12345-0@lo:104: 00010000:00010000:2.0:1787380246.195566:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda000/0xcf3c46fdcad68bb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68bbb expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.195614:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787380246.195620:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3699500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+6:10395:x1874203867413504:12345-0@lo:104: Request processed in 78us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380246.195626:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787380246.195642:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787380246.195647:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5e80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:10395:x1874203867413632:12345-0@lo:104: 00010000:00010000:2.0:1787380246.195660:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68a8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68a95 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.195694:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787380246.195699:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5e80050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:10395:x1874203867413632:12345-0@lo:104: Request processed in 53us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380246.195705:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787380246.195730:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787380246.195736:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:10395:x1874203867413760:12345-0@lo:104: 00010000:00010000:2.0:1787380246.195742:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89dc00/0xcf3c46fdcad68a3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.195769:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787380246.195775:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:10395:x1874203867413760:12345-0@lo:104: Request processed in 40us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380246.195780:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787380246.195792:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787380246.195798:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:10395:x1874203867413888:12345-0@lo:104: 00010000:00010000:2.0:1787380246.195805:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031c00/0xcf3c46fdcad68a2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68a33 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.195844:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787380246.195849:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:10395:x1874203867413888:12345-0@lo:104: Request processed in 52us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380246.195853:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1787380246.195871:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787380246.195876:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda000/0xcf3c46fdcad68bb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68bbb expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.195895:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fda000 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:2.0:1787380246.195899:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda000/0xcf3c46fdcad68bb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68bbb expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.195906:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda000/0xcf3c46fdcad68bb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68bbb expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380246.195912:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda000/0xcf3c46fdcad68bb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68bbb expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380246.195918:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787380246.195941:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda000/0xcf3c46fdcad68bb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68bbb expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.195947:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787380246.195965:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda000/0xcf3c46fdcad68bb4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68bbb expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.195971:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda000/0xcf3c46fdcad68bb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68bbb expref: -99 pid: 9513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.195983:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787380246.195987:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68a8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68a95 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.195992:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc0030200 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:2.0:1787380246.195995:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68a8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68a95 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.196011:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68a95 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380246.196017:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68a95 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380246.196023:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787380246.196037:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68a8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68a95 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.196042:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787380246.196057:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68a8e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68a95 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.196064:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030200/0xcf3c46fdcad68a8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68a95 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.196074:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787380246.196078:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89dc00/0xcf3c46fdcad68a3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.196083:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89dc00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:2.0:1787380246.196086:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89dc00/0xcf3c46fdcad68a3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.196093:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89dc00/0xcf3c46fdcad68a3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380246.196099:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89dc00/0xcf3c46fdcad68a3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380246.196108:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787380246.196120:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89dc00/0xcf3c46fdcad68a3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.196125:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787380246.196131:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89dc00/0xcf3c46fdcad68a3a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.196137:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89dc00/0xcf3c46fdcad68a3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68a41 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.196146:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380246.196149:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031c00/0xcf3c46fdcad68a2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68a33 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.196155:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc0031c00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:2.0:1787380246.196162:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031c00/0xcf3c46fdcad68a2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68a33 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.196169:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031c00/0xcf3c46fdcad68a2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68a33 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380246.196176:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031c00/0xcf3c46fdcad68a2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68a33 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380246.196181:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787380246.196191:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031c00/0xcf3c46fdcad68a2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68a33 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.196195:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787380246.196207:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031c00/0xcf3c46fdcad68a2c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68a33 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.196214:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031c00/0xcf3c46fdcad68a2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68a33 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.196228:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380246.196230:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380246.196233:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380246.196240:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380246.196245:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380246.196256:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867414016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380246.196741:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867414144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380246.196767:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380246.196798:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380246.196804:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867414272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380246.196842:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380246.197031:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867414144 00000100:00100000:0.0:1787380246.197037:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867414144 00010000:00010000:0.0:1787380246.197060:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe0a9aa00/0xcf3c46fdcad68a95 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a8e expref: 24 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380246.197081:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867414272 00000100:00100000:0.0:1787380246.197097:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867414272 00010000:00010000:0.0:1787380246.197110:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe0a9be00/0xcf3c46fdcad68a41 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a3a expref: 25 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380246.197128:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787380246.197135:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3359500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+25:3639:x1874203867414144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787380246.197144:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380246.197155:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe0a9aa00/0xcf3c46fdcad68a95 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a8e expref: 25 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380246.197165:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe0a9aa00/0xcf3c46fdcad68a95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a8e expref: 25 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380246.197180:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380246.197212:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3359500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+25:3639:x1874203867414144:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380246.197219:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787380246.197245:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787380246.197252:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec335a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867414272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787380246.197260:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380246.197265:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe0a9be00/0xcf3c46fdcad68a41 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a3a expref: 24 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380246.197272:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe0a9be00/0xcf3c46fdcad68a41 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a3a expref: 24 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380246.197282:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380246.197302:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec335a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867414272:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380246.197308:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787380246.197345:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867414272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380246.197355:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867414144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787380246.199361:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380246.199409:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380246.199717:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867414016 00000100:00100000:0.0:1787380246.199726:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867414016 00010000:00010000:0.0:1787380246.199753:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d7002045e00/0xcf3c46fdcad68bbb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68bb4 expref: 24 pid: 6513 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380246.199805:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787380246.199834:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3642:x1874203867414016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787380246.199846:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380246.199851:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d7002045e00/0xcf3c46fdcad68bbb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68bb4 expref: 24 pid: 6513 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380246.199862:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d7002045e00/0xcf3c46fdcad68bbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68bb4 expref: 24 pid: 6513 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380246.199879:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380246.199917:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3642:x1874203867414016:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380246.199923:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1787380246.200037:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d7002045e00/0xcf3c46fdcad68bbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68bb4 expref: 23 pid: 6513 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380246.200052:0:10395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874203867413504:0@lo:104: 00010000:00010000:1.0:1787380246.200063:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9aa00/0xcf3c46fdcad68a95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68a8e expref: 22 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380246.200072:0:10395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874203867413632:0@lo:104: 00010000:00010000:1.0:1787380246.200080:0:10395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9be00/0xcf3c46fdcad68a41 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68a3a expref: 21 pid: 6516 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380246.200088:0:10395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874203867413760:0@lo:104: 00000100:00100000:1.0:1787380246.200095:0:10395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874203867413888:0@lo:104: 00000100:00100000:2.0:1787380246.200160:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867414400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380246.202649:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380246.202710:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867414016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380246.202769:0:10339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867414400 00000100:00100000:1.0:1787380246.202775:0:10339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867414400 00010000:00010000:1.0:1787380246.202803:0:10339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe0a9a800/0xcf3c46fdcad68a33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a2c expref: 21 pid: 6515 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380246.202858:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787380246.202866:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:3642:x1874203867414400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380246.202878:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380246.202883:0:10339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe0a9a800/0xcf3c46fdcad68a33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a2c expref: 21 pid: 6515 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380246.202893:0:10339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe0a9a800/0xcf3c46fdcad68a33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68a2c expref: 21 pid: 6515 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380246.202907:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9a800/0xcf3c46fdcad68a33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68a2c expref: 21 pid: 6515 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380246.202920:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380246.202952:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:3642:x1874203867414400:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380246.202958:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787380246.203061:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867414400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380246.203776:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380246.203884:0:10395:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10395:1874203867413376:192.168.206.30@tcp:104: 00010000:00010000:1.0:1787380246.203912:0:10395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad68d97 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380246.204019:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848481024 00000100:00100000:2.0:1787380246.204025:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848481024 00010000:00010000:2.0:1787380246.204044:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68cd3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab14 expref: 10 pid: 6515 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380246.204071:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 39 00000100:00100000:2.0:1787380246.204078:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec335aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2400:x1874203848481024:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380246.204087:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380246.204092:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68cd3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab14 expref: 10 pid: 6515 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.204101:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68cd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab14 expref: 10 pid: 6515 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.204132:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68cd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab14 expref: 10 pid: 6515 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.204144:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad68d97 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.204151:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad68d97 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.204164:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad68d97 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.204170:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad68d97 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.204177:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad68d97 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.204184:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad68d97 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.204190:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165b200 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380246.204193:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad68d97 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.204200:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad68d97 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.204219:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad68d97 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380246.204356:0:10395:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad68d97 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380246.204364:0:10395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad68d97 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.205316:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad68d97 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.205331:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380246.205379:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec335aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2facc94b-d95a-46d6-aa1a-c4299279749f+9:2400:x1874203848481024:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 1298us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380246.205387:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 39 00010000:00010000:2.0:1787380246.604095:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380246.660992:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380246.661090:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848481152 00000100:00100000:2.0:1787380246.661100:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848481152 00000100:00100000:2.0:1787380246.661156:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 249 00000100:00100000:2.0:1787380246.661167:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+9:6169:x1874203848481152:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380246.661181:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380246.661203:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68d9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ab5a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.661230:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68d9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab5a expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.661241:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68d9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab5a expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380246.661249:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d47000, rc 0) 00000100:00100000:2.0:1787380246.661312:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6169:x1874203848481152:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 Request processed in 147us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380246.661319:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 249 00000100:00100000:1.0:1787380246.678266:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380246.678373:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848481280 00000100:00100000:2.0:1787380246.678396:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848481280 00000100:00100000:2.0:1787380246.678453:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 250 00000100:00100000:2.0:1787380246.678462:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6169:x1874203848481280:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380246.678621:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6169:x1874203848481280:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 Request processed in 159us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380246.678628:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 250 00000100:00100000:3.0:1787380246.685390:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380246.685493:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848481408 00000100:00100000:0.0:1787380246.685503:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848481408 00000100:00100000:0.0:1787380246.685568:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 251 00000100:00100000:0.0:1787380246.685578:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6169:x1874203848481408:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380246.685734:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6169:x1874203848481408:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 Request processed in 157us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380246.685741:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 251 00000100:00100000:1.0:1787380246.692456:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380246.692924:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848481536 00000100:00100000:0.0:1787380246.692943:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848481536 00000100:00100000:0.0:1787380246.692995:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 252 00000100:00100000:0.0:1787380246.693006:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6693:x1874203848481536:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787380246.693160:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6693:x1874203848481536:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 156us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380246.693168:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 252 00000100:00100000:1.0:1787380246.718557:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380246.718703:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848481664 00000100:00100000:2.0:1787380246.718715:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848481664 00000100:00100000:2.0:1787380246.718778:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 253 00000100:00100000:2.0:1787380246.718792:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6693:x1874203848481664:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787380246.719184:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+10:6693:x1874203848481664:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 390us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380246.719193:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 253 10000000:01000000:1.0:1787380247.115947:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787380247.115954:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fff5a3000 from 4 10000000:01000000:1.0:1787380247.115959:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787380247.116003:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ae00/0xcf3c46fdcad68da5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380247.116016:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ae00/0xcf3c46fdcad68da5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380247.116026:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ae00/0xcf3c46fdcad68da5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380247.116051:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867414528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787380247.116130:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380247.116210:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd6376c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380247.118992:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867414528 00000100:00100000:0.0:1787380247.119006:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867414528 00000100:00100000:0.0:1787380247.119069:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787380247.119079:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867414528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380247.119095:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380247.119233:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7867c00/0xcf3c46fdcad68dac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68da5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380247.119262:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7867c00/0xcf3c46fdcad68dac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68da5 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380247.119285:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7867c00/0xcf3c46fdcad68dac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68da5 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380247.119294:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867c00, rc 0) 00000100:00100000:0.0:1787380247.119499:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867414528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 421us (3367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380247.119506:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787380247.121368:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867414528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380247.121391:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ae00/0xcf3c46fdcad68da5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380247.121403:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ae00/0xcf3c46fdcad68da5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380247.121482:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867414656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380247.121531:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380247.121592:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd6376c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380247.121890:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867414656 00000100:00100000:0.0:1787380247.121897:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867414656 00000100:00100000:0.0:1787380247.121938:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787380247.121947:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867414656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380247.122082:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867414656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380247.122181:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787380247.123339:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867414656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380247.123388:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867414784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380247.123447:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380247.123471:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd6376c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380247.123624:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867414784 00000100:00100000:0.0:1787380247.123631:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867414784 00000100:00100000:0.0:1787380247.123671:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787380247.123679:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867414784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380247.123782:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867414784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380247.123789:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787380247.124006:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867414784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380247.124497:0:10417:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10417:1874203867414912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380247.124538:0:10417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380247.124577:0:10417:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3c3e840 going to sleep for 11 seconds 00000100:00100000:3.0:1787380247.124627:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867414912 00000100:00100000:3.0:1787380247.124632:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867414912 00000100:00100000:3.0:1787380247.124662:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787380247.124668:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:10417:x1874203867414912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380247.124749:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:10417:x1874203867414912:12345-0@lo:502:llog_process_th.0 Request processed in 80us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380247.124761:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787380247.124841:0:10417:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10417:1874203867414912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787380247.124861:0:10417:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787380247.124869:0:10417:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380247.124871:0:10417:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787380247.124877:0:10417:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6fff5a3000 00000020:00000080:2.0:1787380247.124879:0:10417:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787380247.124948:0:10417:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10417:1874203867415040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380247.124981:0:10417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380247.125007:0:10417:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3c3e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787380247.125062:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867415040 00000100:00100000:1.0:1787380247.125067:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867415040 00000100:00100000:1.0:1787380247.125099:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787380247.125118:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:10417:x1874203867415040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380247.125181:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:10417:x1874203867415040:12345-0@lo:502:llog_process_th.0 Request processed in 65us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380247.125187:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787380247.132075:0:10417:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10417:1874203867415040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787380247.132130:0:10417:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380247.132138:0:10417:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380247.132141:0:10417:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787380247.132145:0:10417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787380247.132331:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787380247.132352:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787380247.132362:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ae00/0xcf3c46fdcad68da5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380247.132373:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ae00/0xcf3c46fdcad68da5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380247.132382:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787380247.132384:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ff5cad800 from 4 10000000:01000000:1.0:1787380247.132387:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787380247.132418:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68db3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380247.132426:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68db3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380247.132443:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68db3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380247.132464:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867415168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787380247.132521:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380247.132579:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd63766c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380247.132624:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867415168 00000100:00100000:2.0:1787380247.132631:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867415168 00000100:00100000:2.0:1787380247.132676:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787380247.132684:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867415168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380247.132696:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380247.132708:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5d46200/0xcf3c46fdcad68dba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68db3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380247.132729:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5d46200/0xcf3c46fdcad68dba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68db3 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380247.132740:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5d46200/0xcf3c46fdcad68dba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68db3 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380247.132749:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46200, rc 0) 00000100:00100000:2.0:1787380247.132793:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867415168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380247.132800:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787380247.132957:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867415168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380247.132970:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68db3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68dba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380247.132978:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68db3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68dba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380247.133025:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867415296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380247.133050:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380247.133076:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd63766c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380247.133136:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867415296 00000100:00100000:2.0:1787380247.133141:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867415296 00000100:00100000:2.0:1787380247.133171:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787380247.133178:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867415296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380247.133278:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867415296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380247.133297:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787380247.133358:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867415296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380247.133387:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3359880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867415424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380247.133430:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380247.133454:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76540 going to sleep for 11 seconds 00000100:00100000:2.0:1787380247.133560:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867415424 00000100:00100000:2.0:1787380247.133564:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867415424 00000100:00100000:2.0:1787380247.133595:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787380247.133602:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867415424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380247.133677:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867415424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380247.133684:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787380247.133720:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3359880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867415424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380247.133900:0:10419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10419:1874203867415552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380247.133934:0:10419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380247.133951:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867415552 00000100:00100000:2.0:1787380247.133955:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867415552 00000100:00100000:2.0:1787380247.133972:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787380247.133977:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:10419:x1874203867415552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380247.134040:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:10419:x1874203867415552:12345-0@lo:502:llog_process_th.0 Request processed in 61us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380247.134047:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787380247.134072:0:10419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3c3e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380247.134083:0:10419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10419:1874203867415552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787380247.134102:0:10419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787380247.134108:0:10419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380247.134110:0:10419:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787380247.134116:0:10419:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6ff5cad800 00000020:00000080:2.0:1787380247.134118:0:10419:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787380247.134191:0:10419:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10419:1874203867415680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380247.134225:0:10419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380247.134241:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867415680 00000100:00100000:2.0:1787380247.134244:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867415680 00000100:00100000:2.0:1787380247.134261:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787380247.134267:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:10419:x1874203867415680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380247.134320:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:10419:x1874203867415680:12345-0@lo:502:llog_process_th.0 Request processed in 53us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380247.134327:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787380247.134352:0:10419:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3c3e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380247.134364:0:10419:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10419:1874203867415680:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787380247.134381:0:10419:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380247.134385:0:10419:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380247.134386:0:10419:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787380247.134390:0:10419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787380247.134428:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787380247.134443:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787380247.134451:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68db3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68dba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380247.134461:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68db3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68dba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380247.134471:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787380247.134473:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ff3dad800 from 4 10000000:01000000:2.0:1787380247.134475:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787380247.134493:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68dc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380247.134510:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68dc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380247.134519:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68dc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380247.134530:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867415808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787380247.134571:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380247.134584:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3c3e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380247.134595:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867415808 00000100:00100000:2.0:1787380247.134598:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867415808 00000100:00100000:2.0:1787380247.134614:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787380247.134620:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867415808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380247.134627:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380247.134636:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5d47a00/0xcf3c46fdcad68dc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68dc1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380247.134652:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5d47a00/0xcf3c46fdcad68dc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68dc1 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380247.134661:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5d47a00/0xcf3c46fdcad68dc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68dc1 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380247.134668:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d47a00, rc 0) 00000100:00100000:2.0:1787380247.134695:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867415808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380247.134701:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787380247.134735:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867415808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380247.134744:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68dc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68dc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380247.134753:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68dc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68dc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380247.134787:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867415936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380247.134831:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380247.134843:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3c3e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380247.134852:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867415936 00000100:00100000:2.0:1787380247.134855:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867415936 00000100:00100000:2.0:1787380247.134871:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787380247.134876:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867415936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380247.134943:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867415936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380247.134949:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1787380247.134974:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867415936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380247.134994:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867416064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380247.135025:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380247.135037:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3c3e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380247.135047:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867416064 00000100:00100000:2.0:1787380247.135050:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867416064 00000100:00100000:2.0:1787380247.135065:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787380247.135070:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867416064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380247.141839:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867416064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6760us (6805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380247.141860:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1787380247.142173:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867416064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380247.144156:0:10422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10422:1874203867416192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380247.144219:0:10422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380247.144262:0:10422:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd6376540 going to sleep for 11 seconds 00000100:00100000:2.0:1787380247.144464:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867416192 00000100:00100000:2.0:1787380247.144470:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867416192 00000100:00100000:2.0:1787380247.144513:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787380247.144521:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:10422:x1874203867416192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380247.144630:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:10422:x1874203867416192:12345-0@lo:502:llog_process_th.0 Request processed in 109us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380247.144637:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787380247.144718:0:10422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10422:1874203867416192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787380247.144742:0:10422:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380247.144750:0:10422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380247.144752:0:10422:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787380247.144758:0:10422:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6ff3dad800 00000020:00000080:1.0:1787380247.144766:0:10422:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787380247.144868:0:10422:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10422:1874203867416320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380247.144902:0:10422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380247.144919:0:10422:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd6376540 going to sleep for 11 seconds 00000100:00100000:2.0:1787380247.145783:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867416320 00000100:00100000:2.0:1787380247.145789:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867416320 00000100:00100000:2.0:1787380247.145887:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787380247.145895:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:10422:x1874203867416320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380247.152968:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:10422:x1874203867416320:12345-0@lo:502:llog_process_th.0 Request processed in 7065us (8057us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380247.152982:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1787380247.153984:0:10422:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10422:1874203867416320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787380247.154027:0:10422:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380247.154036:0:10422:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380247.154038:0:10422:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787380247.154042:0:10422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787380247.154183:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787380247.154207:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787380247.154216:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68dc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68dc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380247.154226:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68dc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68dc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380247.154236:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787380247.154239:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fc873b000 from 4 10000000:01000000:2.0:1787380247.154241:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787380247.154270:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46600/0xcf3c46fdcad68dcf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380247.154289:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46600/0xcf3c46fdcad68dcf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380247.154299:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46600/0xcf3c46fdcad68dcf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380247.154318:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867416448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787380247.154378:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380247.154409:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3c3ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787380247.154425:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867416448 00000100:00100000:2.0:1787380247.154429:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867416448 00000100:00100000:2.0:1787380247.154465:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787380247.154473:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867416448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380247.154486:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380247.154497:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68dd6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68dcf expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380247.154519:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68dd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68dcf expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380247.154529:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68dd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68dcf expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380247.154537:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d47800, rc 0) 00000100:00100000:2.0:1787380247.154583:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:6518:x1874203867416448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380247.154589:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787380247.154628:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867416448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380247.154638:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46600/0xcf3c46fdcad68dcf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68dd6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380247.154647:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46600/0xcf3c46fdcad68dcf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68dd6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380247.154690:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867416576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380247.154715:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380247.154728:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3c3ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787380247.154740:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867416576 00000100:00100000:2.0:1787380247.154743:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867416576 00000100:00100000:2.0:1787380247.154764:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787380247.154770:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:6518:x1874203867416576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380247.154925:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:6518:x1874203867416576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380247.154931:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787380247.155488:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867416576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380247.155518:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867416704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380247.155570:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380247.155591:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3c3ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1787380247.155601:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867416704 00000100:00100000:2.0:1787380247.155605:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867416704 00000100:00100000:2.0:1787380247.155625:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787380247.155631:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:6518:x1874203867416704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380247.155699:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:6518:x1874203867416704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380247.155711:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787380247.155747:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867416704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380247.159534:0:10423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10423:1874203867416832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380247.159629:0:10423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380247.159674:0:10423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd6376900 going to sleep for 11 seconds 00000100:00100000:2.0:1787380247.160145:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867416832 00000100:00100000:2.0:1787380247.160152:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867416832 00000100:00100000:2.0:1787380247.160192:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787380247.160199:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:10423:x1874203867416832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380247.160317:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:10423:x1874203867416832:12345-0@lo:502:llog_process_th.0 Request processed in 117us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380247.160325:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787380247.160716:0:10423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10423:1874203867416832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787380247.160747:0:10423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380247.160756:0:10423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380247.160758:0:10423:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787380247.160763:0:10423:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6fc873b000 00000020:00000080:1.0:1787380247.160766:0:10423:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787380247.162243:0:10423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10423:1874203867416960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380247.162534:0:10423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380247.162584:0:10423:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd6376900 going to sleep for 11 seconds 00000100:00100000:2.0:1787380247.163237:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867416960 00000100:00100000:2.0:1787380247.163246:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867416960 00000100:00100000:2.0:1787380247.163303:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787380247.163313:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:10423:x1874203867416960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380247.163426:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:10423:x1874203867416960:12345-0@lo:502:llog_process_th.0 Request processed in 113us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380247.163433:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787380247.164679:0:10423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:10423:1874203867416960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787380247.164711:0:10423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380247.164719:0:10423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380247.164721:0:10423:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787380247.164725:0:10423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787380247.166188:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787380247.166217:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787380247.166229:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46600/0xcf3c46fdcad68dcf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68dd6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380247.166241:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46600/0xcf3c46fdcad68dcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68dd6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380247.628010:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380248.653175:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380249.228137:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867417088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380249.228208:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380249.228369:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867417088 00000100:00100000:1.0:1787380249.228402:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867417088 00000100:00100000:1.0:1787380249.228458:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787380249.228467:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867417088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787380249.228501:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787380249.228555:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867417088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380249.228562:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787380249.228826:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867417344:0@lo:400:kworker.0 00000100:00100000:3.0:1787380249.228858:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380249.228876:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867417856:0@lo:400:kworker.0 00000100:00100000:3.0:1787380249.228896:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380249.228918:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1874203867418368:0@lo:400:kworker.0 00000100:00100000:3.0:1787380249.228937:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380249.228959:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787380249.228965:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867417216:0@lo:400:kworker.0 00000100:00100000:3.0:1787380249.228991:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380249.229008:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1874203867417728:0@lo:400:kworker.0 00000100:00100000:3.0:1787380249.229025:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380249.229039:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1874203867418240:0@lo:400:kworker.0 00000100:00100000:3.0:1787380249.229056:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380249.229074:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867417344 00000100:00100000:3.0:1787380249.229077:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867417344 00000100:00100000:3.0:1787380249.229097:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867417856 00000100:00100000:3.0:1787380249.229099:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867417856 00000100:00100000:3.0:1787380249.229120:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867418368 00000100:00100000:3.0:1787380249.229123:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867418368 00000100:00100000:3.0:1787380249.229134:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867417728 00000100:00100000:3.0:1787380249.229137:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867417728 00000100:00100000:3.0:1787380249.229147:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867418240 00000100:00100000:3.0:1787380249.229149:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867418240 00000100:00100000:3.0:1787380249.229163:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787380249.229169:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867417344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380249.229214:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867417344:12345-0@lo:400:kworker.0 Request processed in 45us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380249.229221:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787380249.229243:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787380249.229249:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867417856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380249.229275:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867417856:12345-0@lo:400:kworker.0 Request processed in 27us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380249.229280:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787380249.229293:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787380249.229299:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874203867418368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380249.229324:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874203867418368:12345-0@lo:400:kworker.0 Request processed in 25us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380249.229330:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787380249.229342:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787380249.229347:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874203867417728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380249.229370:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874203867417728:12345-0@lo:400:kworker.0 Request processed in 23us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380249.229375:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787380249.229576:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787380249.229585:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874203867418240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380249.229615:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874203867418240:12345-0@lo:400:kworker.0 Request processed in 33us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380249.229621:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1787380249.229652:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787380249.229656:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787380249.229693:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1874203867417728:0@lo:400:kworker.0 00000100:00100000:1.0:1787380249.229706:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1874203867418240:0@lo:400:kworker.0 00000100:00100000:1.0:1787380249.229716:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867417344:0@lo:400:kworker.0 00010000:00080000:1.0:1787380249.229727:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3685500 x1874203867417856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380249.229736:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867417856:0@lo:400:kworker.0 00010000:00080000:1.0:1787380249.229744:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3686d80 x1874203867418368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380249.229751:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1874203867418368:0@lo:400:kworker.0 00000100:00100000:2.0:1787380249.229969:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867417216 00000100:00100000:2.0:1787380249.229974:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867417216 00000100:00100000:2.0:1787380249.230013:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787380249.230021:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3640:x1874203867417216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380249.230070:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3640:x1874203867417216:12345-0@lo:400:kworker.0 Request processed in 50us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380249.230089:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787380249.230122:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867417600:0@lo:400:kworker.0 00000100:00100000:2.0:1787380249.230149:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380249.230170:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867418112:0@lo:400:kworker.0 00000100:00100000:2.0:1787380249.230190:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380249.230208:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867418624:0@lo:400:kworker.0 00000100:00100000:2.0:1787380249.230226:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380249.230258:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867417088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380249.230272:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787380249.230277:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867417472:0@lo:400:kworker.0 00000100:00100000:2.0:1787380249.230315:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380249.230333:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867417984:0@lo:400:kworker.0 00000100:00100000:2.0:1787380249.230353:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380249.230367:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867418496:0@lo:400:kworker.0 00000100:00100000:2.0:1787380249.230397:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380249.230421:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867418112 00000100:00100000:2.0:1787380249.230424:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867418112 00000100:00100000:2.0:1787380249.230450:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867418624 00000100:00100000:2.0:1787380249.230454:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867418624 00000100:00100000:2.0:1787380249.230466:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867417984 00000100:00100000:2.0:1787380249.230468:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867417984 00000100:00100000:2.0:1787380249.230479:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867418496 00000100:00100000:2.0:1787380249.230481:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867418496 00000100:00100000:2.0:1787380249.230492:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787380249.230497:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867418112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380249.230541:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867418112:12345-0@lo:400:kworker.0 Request processed in 32us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380249.230554:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787380249.230565:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787380249.230571:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867418624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380249.230599:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867418624:12345-0@lo:400:kworker.0 Request processed in 28us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380249.230604:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787380249.230614:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787380249.230620:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867417984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380249.230644:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867417984:12345-0@lo:400:kworker.0 Request processed in 24us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380249.230649:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787380249.230658:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787380249.230663:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867418496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380249.230685:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867418496:12345-0@lo:400:kworker.0 Request processed in 22us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380249.230690:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787380249.230706:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787380249.230708:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380249.230715:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867417472 00000100:00100000:2.0:1787380249.230718:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867417472 00000100:00100000:2.0:1787380249.230752:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787380249.230759:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867417472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380249.230786:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867417472:12345-0@lo:400:kworker.0 Request processed in 28us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380249.230792:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787380249.230845:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867417600 00000100:00100000:2.0:1787380249.230849:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867417600 00000100:00100000:2.0:1787380249.230871:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787380249.230877:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867417600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380249.230908:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867417600:12345-0@lo:400:kworker.0 Request processed in 31us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380249.230913:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787380249.230940:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867417472:0@lo:400:kworker.0 00010000:00080000:2.0:1787380249.230950:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3686680 x1874203867417984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380249.230958:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867417984:0@lo:400:kworker.0 00010000:00080000:2.0:1787380249.230965:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3687480 x1874203867418496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380249.230972:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867418496:0@lo:400:kworker.0 00000100:00100000:2.0:1787380249.230980:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867417600:0@lo:400:kworker.0 00010000:00080000:2.0:1787380249.230988:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3686a00 x1874203867418112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380249.230994:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867418112:0@lo:400:kworker.0 00010000:00080000:2.0:1787380249.231002:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3684000 x1874203867418624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380249.231009:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867418624:0@lo:400:kworker.0 00000100:00100000:1.0:1787380249.231433:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867417216:0@lo:400:kworker.0 00000100:00100000:0.0:1787380249.231912:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867418752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380249.231952:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380249.232038:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867418752 00000100:00100000:1.0:1787380249.232045:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867418752 00000100:00100000:1.0:1787380249.232087:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787380249.232094:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec335ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867418752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380249.232117:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380249.232154:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec335ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867418752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380249.232161:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787380249.232232:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec369a680 x1874203867418752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380249.232246:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867418752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380249.234422:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867418880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787380249.234483:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380249.234653:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867418880 00000100:00100000:1.0:1787380249.234660:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867418880 00000100:00100000:1.0:1787380249.234707:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787380249.234716:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867418880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787380249.234734:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380249.234788:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867418880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380249.234795:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787380249.235201:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec336f100 x1874203867418880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380249.235219:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867418880:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787380249.676592:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380249.740666:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380249.740696:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867419008:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380249.740769:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380249.740844:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867419008 00000100:00100000:3.0:1787380249.740852:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867419008 00000100:00100000:3.0:1787380249.740891:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787380249.740899:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867419008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787380249.740934:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380249.740972:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867419008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380249.740979:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787380249.741023:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec20a4380 x1874203867419008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380249.741039:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867419008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380249.741799:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380249.741840:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867419136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380249.741878:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380249.742478:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867419136 00000100:00100000:2.0:1787380249.742493:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867419136 00000100:00100000:2.0:1787380249.742544:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787380249.742552:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec335b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867419136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380249.742569:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380249.742619:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec335b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867419136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380249.742625:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1787380249.743348:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec336ca80 x1874203867419136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380249.743367:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867419136:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787380250.702187:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380250.774391:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867419264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787380250.774455:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380250.774569:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867419264 00000100:00100000:3.0:1787380250.774577:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867419264 00000100:00100000:3.0:1787380250.774643:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787380250.774652:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867419264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787380250.774682:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787380250.788787:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867419264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 14125us (14320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380250.788802:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787380250.789074:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867419264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787380250.789715:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380250.789750:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380250.789777:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380250.789795:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380250.789836:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380250.789867:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848482048 00000100:00100000:3.0:1787380250.789874:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848482048 00000100:00100000:3.0:1787380250.790047:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848481920 00000100:00100000:3.0:1787380250.790051:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848481920 00000100:00100000:3.0:1787380250.790076:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 73 00000100:00100000:2.0:1787380250.790189:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848481792 00000100:00100000:2.0:1787380250.790193:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848481792 00000100:00100000:2.0:1787380250.790222:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 275 00000100:00100000:2.0:1787380250.790229:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2400:x1874203848481792:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380250.790361:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2400:x1874203848481792:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 132us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380250.790368:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 275 00000100:00100000:2.0:1787380250.790397:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848482304 00000100:00100000:2.0:1787380250.790401:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848482304 00000100:00100000:2.0:1787380250.790424:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848482176 00000100:00100000:2.0:1787380250.790427:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848482176 00000100:00100000:2.0:1787380250.790445:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:2.0:1787380250.790450:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848482304:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380250.790477:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848482304:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 26us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380250.790483:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:2.0:1787380250.790503:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 26 00000100:00100000:2.0:1787380250.790509:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848482176:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380250.790546:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848482176:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 37us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380250.790552:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 26 00000100:00080000:2.0:1787380250.790569:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787380250.790572:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787380250.790574:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380250.790576:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787380250.791050:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848482048:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380250.791153:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848482048:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 1004us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380250.791160:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 73 00000100:00100000:3.0:1787380250.791187:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 74 00000100:00100000:3.0:1787380250.791194:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2400:x1874203848481920:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380250.791221:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2400:x1874203848481920:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 27us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380250.791227:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 74 00010000:00010000:2.0:1787380251.724955:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380252.755097:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787380253.750980:0:10696:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1787380253.774357:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380254.350429:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380254.350449:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867419392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380254.350521:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380254.350575:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867419392 00000100:00100000:2.0:1787380254.350582:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867419392 00000100:00100000:2.0:1787380254.350618:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787380254.350625:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867419392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787380254.350655:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787380254.350714:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867419392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380254.350720:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787380254.350764:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867419392:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787380254.352179:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787380254.352194:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867419520:0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.352239:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380254.352297:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867419648:0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.352329:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380254.352357:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867419648 00000100:00100000:1.0:1787380254.352364:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867419648 00000100:00100000:1.0:1787380254.352398:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787380254.352406:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867419648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.352462:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867419648:12345-0@lo:400:kworker.0 Request processed in 55us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380254.352469:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787380254.352513:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867419648:0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.352549:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380254.352556:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867419776:0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.352580:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380254.352617:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867419904:0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.352637:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380254.352671:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787380254.352677:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1874203867420032:0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.352697:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380254.352732:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867420160:0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.352752:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380254.352774:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867419776 00000100:00100000:1.0:1787380254.352777:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867419776 00000100:00100000:1.0:1787380254.352795:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867420032 00000100:00100000:1.0:1787380254.352797:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867420032 00000100:00100000:1.0:1787380254.352834:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867420160 00000100:00100000:1.0:1787380254.352837:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867420160 00000100:00100000:1.0:1787380254.352851:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787380254.352857:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec369a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867419776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.352893:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec369a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867419776:12345-0@lo:400:kworker.0 Request processed in 35us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380254.352899:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787380254.352910:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787380254.352925:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874203867420032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.352958:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874203867420032:12345-0@lo:400:kworker.0 Request processed in 35us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380254.352964:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787380254.352974:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787380254.352979:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867420160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.353001:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867420160:12345-0@lo:400:kworker.0 Request processed in 22us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380254.353006:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787380254.353034:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867419776:0@lo:400:kworker.0 00010000:00080000:1.0:1787380254.353122:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3686a00 x1874203867420160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380254.353132:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867420160:0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.353140:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1874203867420032:0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.353165:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380254.353171:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867420288:0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.353191:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380254.353222:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867420416:0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.353241:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380254.353275:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787380254.353281:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1874203867420544:0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.353300:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380254.353318:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867420544 00000100:00100000:1.0:1787380254.353322:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867420544 00000100:00100000:1.0:1787380254.353352:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787380254.353358:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874203867420544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.353387:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874203867420544:12345-0@lo:400:kworker.0 Request processed in 30us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380254.353393:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787380254.353417:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1874203867420544:0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.353441:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867420672:0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.353458:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380254.353474:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867420672 00000100:00100000:1.0:1787380254.353477:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867420672 00000100:00100000:1.0:1787380254.353494:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787380254.353500:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867420672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.353541:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867420672:12345-0@lo:400:kworker.0 Request processed in 41us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380254.353546:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:1.0:1787380254.353569:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3687800 x1874203867420672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380254.353578:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867420672:0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.353604:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380254.353610:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867420800:0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.353629:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380254.353663:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867420928:0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.353681:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787380254.353823:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787380254.353827:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380254.353837:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867420288 00000100:00100000:2.0:1787380254.353840:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867420288 00000100:00100000:2.0:1787380254.353870:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867420416 00000100:00100000:2.0:1787380254.353872:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867420416 00000100:00100000:2.0:1787380254.353882:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867420800 00000100:00100000:2.0:1787380254.353884:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867420800 00000100:00100000:2.0:1787380254.353893:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867420928 00000100:00100000:2.0:1787380254.353895:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867420928 00000100:00100000:2.0:1787380254.353906:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787380254.353911:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867420288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380254.353950:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867420288:12345-0@lo:400:kworker.0 Request processed in 38us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380254.353956:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787380254.353968:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787380254.353974:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867420416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380254.353997:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867420416:12345-0@lo:400:kworker.0 Request processed in 25us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380254.354002:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787380254.354012:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787380254.354017:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867420800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380254.354042:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867420800:12345-0@lo:400:kworker.0 Request processed in 25us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380254.354061:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787380254.354071:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787380254.354077:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867420928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380254.354101:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867420928:12345-0@lo:400:kworker.0 Request processed in 24us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380254.354106:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787380254.354122:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787380254.354132:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380254.354141:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867419904 00000100:00100000:2.0:1787380254.354144:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867419904 00000100:00100000:2.0:1787380254.354167:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787380254.354173:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867419904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380254.354202:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867419904:12345-0@lo:400:kworker.0 Request processed in 29us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380254.354207:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1787380254.354237:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3685c00 x1874203867420928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380254.354246:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867420928:0@lo:400:kworker.0 00010000:00080000:2.0:1787380254.354256:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3687800 x1874203867420800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380254.354263:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867420800:0@lo:400:kworker.0 00010000:00080000:2.0:1787380254.354272:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3687480 x1874203867420416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380254.354279:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867420416:0@lo:400:kworker.0 00010000:00080000:2.0:1787380254.354287:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3685180 x1874203867420288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380254.354294:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867420288:0@lo:400:kworker.0 00000100:00100000:2.0:1787380254.354303:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867419904:0@lo:400:kworker.0 00000100:00100000:2.0:1787380254.354359:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867419520 00000100:00100000:2.0:1787380254.354363:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867419520 00000100:00100000:2.0:1787380254.354386:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787380254.354400:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3642:x1874203867419520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380254.354431:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3642:x1874203867419520:12345-0@lo:400:kworker.0 Request processed in 32us (2192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380254.354436:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1787380254.357229:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867419520:0@lo:400:kworker.0 00000100:00100000:1.0:1787380254.357254:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787380254.357279:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867421056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787380254.357332:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380254.359871:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867421056 00000100:00100000:2.0:1787380254.359880:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867421056 00000100:00100000:2.0:1787380254.359921:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787380254.359929:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867421056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787380254.359955:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380254.360012:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867421056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (2679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380254.360020:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787380254.360344:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380254.360357:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867421184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380254.360393:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380254.360852:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867421184 00000100:00100000:3.0:1787380254.360857:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867421184 00000100:00100000:3.0:1787380254.360879:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787380254.360886:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867421184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787380254.360899:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380254.360940:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867421184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380254.360946:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787380254.360989:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec336fb80 x1874203867421056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380254.361007:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867421056:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787380254.361660:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3685180 x1874203867421184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380254.361674:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867421184:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787380254.797800:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380254.861412:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787380254.861434:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867421312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380254.861510:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380254.861568:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867421312 00000100:00100000:3.0:1787380254.861575:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867421312 00000100:00100000:3.0:1787380254.861617:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787380254.861625:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867421312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787380254.861650:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380254.861691:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867421312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380254.861698:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787380254.861747:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5d9aa00 x1874203867421312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380254.861763:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867421312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380254.862485:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec335a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867421440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380254.862526:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380254.862557:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867421440 00000100:00100000:0.0:1787380254.862561:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867421440 00000100:00100000:0.0:1787380254.862584:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787380254.862591:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec335b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867421440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380254.862604:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380254.862633:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec335b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867421440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380254.862639:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787380254.862665:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec335a300 x1874203867421440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380254.862678:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec335a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867421440:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787380255.826417:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380255.890425:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec335a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867421568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787380255.890502:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380255.890878:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867421568 00000100:00100000:0.0:1787380255.890896:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867421568 00000100:00100000:0.0:1787380255.890958:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787380255.890967:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867421568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787380255.890997:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787380255.891055:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867421568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380255.891062:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787380255.891230:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec335a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867421568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787380255.905223:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380255.905357:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848482432 00000100:00100000:0.0:1787380255.905367:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848482432 00000100:00100000:0.0:1787380255.905415:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 277 00000100:00100000:0.0:1787380255.905424:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2399:x1874203848482432:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380255.905502:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2399:x1874203848482432:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 70us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380255.905511:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 277 00000100:00100000:3.0:1787380255.930087:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380255.930133:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380255.930162:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380255.930207:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380255.930234:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848482816 00000100:00100000:3.0:1787380255.930242:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848482816 00000100:00100000:3.0:1787380255.930298:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848482944 00000100:00100000:3.0:1787380255.930301:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848482944 00000100:00100000:3.0:1787380255.930318:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 31 00000100:00100000:3.0:1787380255.930326:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848482816:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380255.930380:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848482816:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 55us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380255.930401:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 31 00000100:00100000:3.0:1787380255.930422:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 32 00000100:00100000:3.0:1787380255.930428:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848482944:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380255.930447:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848482944:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 19us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380255.930463:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 32 00000100:00080000:3.0:1787380255.930480:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787380255.930483:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380255.930693:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848482560 00000100:00100000:0.0:1787380255.930697:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848482560 00000100:00100000:0.0:1787380255.930738:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848482688 00000100:00100000:0.0:1787380255.930741:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848482688 00000100:00100000:0.0:1787380255.930763:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 81 00000100:00100000:0.0:1787380255.930771:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2399:x1874203848482560:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380255.930801:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2399:x1874203848482560:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 32us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380255.930834:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 81 00000100:00100000:0.0:1787380255.930847:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 82 00000100:00100000:0.0:1787380255.930854:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848482688:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380255.930879:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848482688:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 26us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380255.930895:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 82 00000100:00080000:3.0:1787380255.932300:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787380255.932306:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787380256.844632:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380257.869361:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787380258.722556:0:10939:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing yml_node 00010000:00010000:1.0:1787380258.892467:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380259.468093:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867421696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787380259.468156:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380259.468203:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867422208:0@lo:400:kworker.0 00000100:00100000:1.0:1787380259.468227:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380259.468246:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec36d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867422720:0@lo:400:kworker.0 00000100:00100000:1.0:1787380259.468267:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380259.468286:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867423232:0@lo:400:kworker.0 00000100:00100000:1.0:1787380259.468306:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380259.468332:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787380259.468338:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867422080:0@lo:400:kworker.0 00000100:00100000:1.0:1787380259.468360:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380259.468374:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec36d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867422592:0@lo:400:kworker.0 00000100:00100000:1.0:1787380259.468391:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380259.468411:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867423104:0@lo:400:kworker.0 00000100:00100000:1.0:1787380259.468430:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380259.468458:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867422720 00000100:00100000:1.0:1787380259.468464:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867422720 00000100:00100000:0.0:1787380259.468700:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867421824:0@lo:400:kworker.0 00000100:00100000:0.0:1787380259.468732:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380259.468756:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867422336:0@lo:400:kworker.0 00000100:00100000:0.0:1787380259.468778:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380259.468793:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867422848:0@lo:400:kworker.0 00000100:00080000:3.0:1787380259.468913:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787380259.468935:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867423232 00000100:00100000:3.0:1787380259.468939:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787380259.468940:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867423232 00000100:00100000:3.0:1787380259.468948:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867422720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380259.468961:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787380259.468967:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffcb19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867423232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380259.468998:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867422720:12345-0@lo:400:kworker.0 Request processed in 51us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380259.469005:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787380259.469024:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787380259.469042:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380259.469059:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867423360:0@lo:400:kworker.0 00000100:00100000:0.0:1787380259.469080:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380259.469090:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787380259.469095:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867421952:0@lo:400:kworker.0 00000100:00100000:0.0:1787380259.469111:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380259.469123:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec36d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867422464:0@lo:400:kworker.0 00000100:00100000:0.0:1787380259.469138:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380259.469145:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867422976:0@lo:400:kworker.0 00000100:00100000:0.0:1787380259.469158:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380259.469165:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867423488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380259.469182:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380259.469203:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867421696 00000100:00100000:0.0:1787380259.469206:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867421696 00000100:00100000:0.0:1787380259.469227:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867423488 00000100:00100000:0.0:1787380259.469229:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867423488 00000100:00100000:0.0:1787380259.469238:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787380259.469242:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867421696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787380259.469273:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380259.469282:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867422848 00000100:00100000:2.0:1787380259.469289:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867422848 00000100:00100000:2.0:1787380259.469312:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867423360 00000100:00100000:2.0:1787380259.469314:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867423360 00000100:00100000:2.0:1787380259.469325:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787380259.469330:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867422848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380259.469371:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867422848:12345-0@lo:400:kworker.0 Request processed in 40us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380259.469376:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787380259.469387:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787380259.469391:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec335bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3639:x1874203867423360:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787380259.469422:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec36d5f80 x1874203867422720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380259.469426:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec335bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3639:x1874203867423360:12345-0@lo:400:kworker.0 Request processed in 33us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380259.469438:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec36d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867422720:0@lo:400:kworker.0 00000100:00100000:2.0:1787380259.469440:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787380259.469458:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34ee300 x1874203867423232/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380259.469468:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867423232:0@lo:400:kworker.0 00000100:00100000:2.0:1787380259.469518:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867423616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380259.469546:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380259.469566:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867421696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 320us (1409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380259.469573:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787380259.469588:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787380259.469594:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1874203867423488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787380259.469604:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380259.469629:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1874203867423488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380259.469635:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787380259.469653:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867422208 00000100:00100000:0.0:1787380259.469657:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867422208 00000100:00100000:0.0:1787380259.469673:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867422592 00000100:00100000:0.0:1787380259.469676:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867422592 00000100:00100000:0.0:1787380259.469687:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867423104 00000100:00100000:0.0:1787380259.469689:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867423104 00000100:00100000:0.0:1787380259.469700:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867421952 00000100:00100000:0.0:1787380259.469702:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867421952 00000100:00100000:0.0:1787380259.469711:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867422464 00000100:00100000:0.0:1787380259.469713:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867422464 00000100:00100000:0.0:1787380259.469724:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867422976 00000100:00100000:0.0:1787380259.469726:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867422976 00000100:00100000:0.0:1787380259.469737:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787380259.469742:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867422208:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1787380259.469747:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3687480 x1874203867421696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380259.469767:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867421696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380259.469772:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867422208:12345-0@lo:400:kworker.0 Request processed in 30us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380259.469777:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787380259.469780:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867422208:0@lo:400:kworker.0 00000100:00100000:0.0:1787380259.469787:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787380259.469799:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867422592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380259.469976:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867422592:12345-0@lo:400:kworker.0 Request processed in 178us (1583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380259.469983:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787380259.469996:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787380259.470002:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867423104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380259.470030:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867423104:12345-0@lo:400:kworker.0 Request processed in 28us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380259.470035:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787380259.470045:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787380259.470051:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867421952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380259.470075:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867421952:12345-0@lo:400:kworker.0 Request processed in 25us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380259.470081:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787380259.470091:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787380259.470096:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867422464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380259.470121:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867422464:12345-0@lo:400:kworker.0 Request processed in 25us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380259.470126:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787380259.470136:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787380259.470142:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec335b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867422976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380259.470164:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec335b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867422976:12345-0@lo:400:kworker.0 Request processed in 23us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380259.470170:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787380259.470187:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867422080 00000100:00100000:0.0:1787380259.470196:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867422080 00000100:00100000:0.0:1787380259.470214:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867422336 00000100:00100000:0.0:1787380259.470217:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867422336 00000100:00100000:0.0:1787380259.470225:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867423616 00000100:00100000:0.0:1787380259.470226:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867423616 00000100:00100000:0.0:1787380259.470235:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787380259.470241:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1874203867422080:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787380259.470277:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec36d4380 x1874203867422592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380259.470279:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1874203867422080:12345-0@lo:400:kworker.0 Request processed in 37us (1917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380259.470294:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787380259.470301:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec36d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867422592:0@lo:400:kworker.0 00000100:00100000:0.0:1787380259.470310:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00010000:00080000:2.0:1787380259.470318:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34ec000 x1874203867423104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380259.470319:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867422336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380259.470334:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867423104:0@lo:400:kworker.0 00000100:00100000:0.0:1787380259.470358:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867422336:12345-0@lo:400:kworker.0 Request processed in 40us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380259.470362:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867422080:0@lo:400:kworker.0 00000100:00100000:0.0:1787380259.470369:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787380259.470384:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787380259.470390:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867423616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787380259.470410:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787380259.470580:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867423616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 188us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380259.470586:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787380259.470687:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867421824 00000100:00100000:0.0:1787380259.470691:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867421824 00000100:00100000:0.0:1787380259.470720:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787380259.470907:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867421824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380259.470946:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867421824:12345-0@lo:400:kworker.0 Request processed in 218us (2211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380259.470960:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787380259.471013:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867421952:0@lo:400:kworker.0 00000100:00100000:0.0:1787380259.471023:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec36d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867422464:0@lo:400:kworker.0 00000100:00100000:0.0:1787380259.471031:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867422976:0@lo:400:kworker.0 00010000:00080000:0.0:1787380259.471041:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5d98000 x1874203867423488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380259.471054:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867423488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380259.471063:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867421824:0@lo:400:kworker.0 00000100:00100000:0.0:1787380259.471072:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867422336:0@lo:400:kworker.0 00010000:00080000:0.0:1787380259.471082:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34ef100 x1874203867422848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380259.471090:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867422848:0@lo:400:kworker.0 00010000:00080000:0.0:1787380259.471099:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34ec700 x1874203867423360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380259.471106:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867423360:0@lo:400:kworker.0 00000100:00080000:0.0:1787380259.471138:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787380259.471142:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787380259.471145:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787380259.471147:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787380259.471925:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867423616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787380259.472023:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffcb19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867423232:12345-0@lo:400:kworker.0 Request processed in 3053us (3712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380259.472032:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1787380259.918324:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380259.980177:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867423744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380259.980244:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380259.980343:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867423744 00000100:00100000:0.0:1787380259.980350:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867423744 00000100:00100000:0.0:1787380259.980394:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787380259.980413:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867423744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380259.980439:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380259.980700:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867423872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380259.984691:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867423744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4260us (4428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380259.984706:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787380259.985896:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3358700 x1874203867423744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380259.985922:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867423744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380259.989127:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380259.989383:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867423872 00000100:00100000:0.0:1787380259.989393:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867423872 00000100:00100000:0.0:1787380259.989449:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787380259.989459:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867423872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787380259.989496:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380259.989560:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867423872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380259.989568:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787380259.989603:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34eed80 x1874203867423872/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380259.989629:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867423872:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787380260.941367:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380261.004463:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380261.012889:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec335a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867424000:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787380261.012970:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380261.013497:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867424000 00000100:00100000:0.0:1787380261.013588:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867424000 00000100:00100000:0.0:1787380261.013920:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787380261.013931:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867424000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787380261.013970:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787380261.014223:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867424000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 294us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380261.014230:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787380261.014315:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec335a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867424000:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787380261.022559:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380261.022601:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380261.022641:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380261.022715:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848483072 00000100:00100000:2.0:1787380261.022725:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848483072 00000100:00100000:2.0:1787380261.022779:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 279 00000100:00100000:2.0:1787380261.022788:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2397:x1874203848483072:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380261.022886:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2397:x1874203848483072:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 99us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380261.022893:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 279 00000100:00100000:1.0:1787380261.023541:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848483328 00000100:00100000:1.0:1787380261.023547:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848483328 00000100:00100000:1.0:1787380261.023604:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848483200 00000100:00100000:1.0:1787380261.023608:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848483200 00000100:00100000:1.0:1787380261.023627:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 89 00000100:00100000:1.0:1787380261.023635:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2397:x1874203848483328:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380261.023691:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2397:x1874203848483328:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 57us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380261.023697:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 89 00000100:00100000:1.0:1787380261.023710:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 90 00000100:00100000:1.0:1787380261.023717:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2397:x1874203848483200:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380261.023749:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2397:x1874203848483200:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 33us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380261.023755:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 90 00000100:00080000:3.0:1787380261.028900:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787380261.028910:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787380261.029560:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380261.029600:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380261.029693:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848483456 00000100:00100000:2.0:1787380261.029702:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848483456 00000100:00100000:2.0:1787380261.029770:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848483584 00000100:00100000:2.0:1787380261.029774:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848483584 00000100:00100000:2.0:1787380261.029798:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:2.0:1787380261.029850:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2396:x1874203848483456:12345-192.168.206.30@tcp:9:kworker.0 00000020:00000080:2.0:1787380261.029892:0:8871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68ce8 00000100:00080000:2.0:1787380261.029902:0:8871:0:(import.c:65:import_set_state_nolock()) ffff9d6ff4ffa800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787380261.029953:0:8871:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787380261.030094:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+2:2396:x1874203848483456:12345-192.168.206.30@tcp:9:kworker.0 Request processed in 287us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380261.030102:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:2.0:1787380261.030116:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:2.0:1787380261.030122:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2396:x1874203848483584:12345-192.168.206.30@tcp:9:kworker.0 00000020:00000080:2.0:1787380261.030135:0:8871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68cef 00000100:00080000:2.0:1787380261.030140:0:8871:0:(import.c:65:import_set_state_nolock()) ffff9d6fff5fb000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787380261.030161:0:8871:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787380261.030226:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+2:2396:x1874203848483584:12345-192.168.206.30@tcp:9:kworker.0 Request processed in 103us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380261.030233:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 19 00010000:00010000:2.0:1787380261.030249:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380261.030254:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787380261.030790:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380261.030795:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787380261.965070:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380262.988057:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787380263.001923:0:11123:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.116 00010000:00010000:2.0:1787380264.013937:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380264.588642:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867424128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380264.588706:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380264.588896:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380264.588903:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867424256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787380264.588925:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380264.588955:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867424128 00000100:00100000:3.0:1787380264.588960:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867424128 00000100:00100000:3.0:1787380264.588996:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867424256 00000100:00100000:3.0:1787380264.588998:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867424256 00000100:00080000:0.0:1787380264.589100:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787380264.589134:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787380264.589155:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867424128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787380264.589181:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380264.589365:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867424128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 211us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380264.589373:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787380264.589397:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787380264.589403:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867424256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787380264.589413:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380264.589445:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867424256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380264.589460:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787380264.589681:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867424768:0@lo:400:kworker.0 00000100:00100000:2.0:1787380264.589710:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380264.589726:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867425280:0@lo:400:kworker.0 00000100:00100000:2.0:1787380264.589753:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380264.589770:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787380264.589775:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867424640:0@lo:400:kworker.0 00000100:00100000:2.0:1787380264.589794:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380264.589824:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867425152:0@lo:400:kworker.0 00000100:00100000:2.0:1787380264.589842:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380264.589855:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867425664:0@lo:400:kworker.0 00000100:00100000:2.0:1787380264.589870:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380264.589892:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867425280 00000100:00100000:2.0:1787380264.589896:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867425280 00000100:00100000:2.0:1787380264.589925:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787380264.589931:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867425280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380264.589961:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867425280:12345-0@lo:400:kworker.0 Request processed in 30us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380264.589967:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787380264.589982:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867424640 00000100:00100000:2.0:1787380264.589984:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867424640 00000100:00100000:2.0:1787380264.590004:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787380264.590023:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867424640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380264.590051:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867424640:12345-0@lo:400:kworker.0 Request processed in 41us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380264.590057:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787380264.590071:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867424768 00000100:00100000:2.0:1787380264.590074:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867424768 00000100:00100000:2.0:1787380264.590092:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867425152 00000100:00100000:2.0:1787380264.590094:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867425152 00000100:00100000:2.0:1787380264.590104:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867425664 00000100:00100000:2.0:1787380264.590111:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867425664 00000100:00100000:2.0:1787380264.590127:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787380264.590132:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867424768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380264.590157:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867424768:12345-0@lo:400:kworker.0 Request processed in 25us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380264.590162:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787380264.590171:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787380264.590176:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867425152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380264.590204:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867425152:12345-0@lo:400:kworker.0 Request processed in 22us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380264.590210:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787380264.590220:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787380264.590226:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867425664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380264.590247:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867425664:12345-0@lo:400:kworker.0 Request processed in 22us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380264.590252:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1787380264.590266:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787380264.590270:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380264.590291:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867424640:0@lo:400:kworker.0 00010000:00080000:2.0:1787380264.590302:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec336fb80 x1874203867425152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380264.590755:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867424384:0@lo:400:kworker.0 00000100:00100000:1.0:1787380264.590791:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380264.590833:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867424896:0@lo:400:kworker.0 00000100:00100000:1.0:1787380264.590853:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380264.590867:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867425408:0@lo:400:kworker.0 00000100:00100000:1.0:1787380264.590884:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380264.590899:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787380264.590904:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867424512:0@lo:400:kworker.0 00000100:00100000:1.0:1787380264.590936:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380264.590950:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867425024:0@lo:400:kworker.0 00000100:00100000:1.0:1787380264.590966:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380264.590978:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867425536:0@lo:400:kworker.0 00000100:00100000:1.0:1787380264.590993:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380264.591020:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867424512 00000100:00100000:1.0:1787380264.591024:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867424512 00000100:00100000:1.0:1787380264.591042:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867425024 00000100:00100000:1.0:1787380264.591044:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867425024 00000100:00100000:1.0:1787380264.591058:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867425536 00000100:00100000:1.0:1787380264.591060:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867425536 00000100:00100000:1.0:1787380264.591081:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787380264.591087:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867424512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380264.591119:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867424512:12345-0@lo:400:kworker.0 Request processed in 32us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380264.591125:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787380264.591135:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787380264.591141:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867425024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380264.591160:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867425024:12345-0@lo:400:kworker.0 Request processed in 20us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380264.591165:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787380264.591174:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787380264.591178:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867425536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380264.591213:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867425536:12345-0@lo:400:kworker.0 Request processed in 34us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380264.591219:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787380264.591235:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867425408 00000100:00100000:1.0:1787380264.591237:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867425408 00000100:00100000:1.0:1787380264.591256:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787380264.591262:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867425408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380264.591286:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867425408:12345-0@lo:400:kworker.0 Request processed in 25us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380264.591291:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787380264.591304:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867424384 00000100:00100000:1.0:1787380264.591307:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867424384 00000100:00100000:1.0:1787380264.591326:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1787380264.591331:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867424384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380264.591785:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867424384:12345-0@lo:400:kworker.0 Request processed in 32us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380264.591794:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00080000:1.0:1787380264.591843:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787380264.591847:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380264.591855:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867424896 00000100:00100000:1.0:1787380264.591859:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867424896 00000100:00100000:1.0:1787380264.591875:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787380264.591880:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867424896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380264.591909:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867424896:12345-0@lo:400:kworker.0 Request processed in 29us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380264.591914:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787380264.591942:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867424512:0@lo:400:kworker.0 00000100:00100000:1.0:1787380264.591952:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867425024:0@lo:400:kworker.0 00000100:00100000:1.0:1787380264.591960:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867425536:0@lo:400:kworker.0 00000100:00100000:1.0:1787380264.591968:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867424384:0@lo:400:kworker.0 00000100:00100000:1.0:1787380264.591975:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867424896:0@lo:400:kworker.0 00010000:00080000:1.0:1787380264.591985:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec336f100 x1874203867425408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380264.591995:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867425408:0@lo:400:kworker.0 00000100:00100000:2.0:1787380264.592171:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867425152:0@lo:400:kworker.0 00010000:00080000:2.0:1787380264.592191:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff3ff9500 x1874203867425664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380264.592213:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867425664:0@lo:400:kworker.0 00000100:00100000:2.0:1787380264.592236:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867424768:0@lo:400:kworker.0 00010000:00080000:2.0:1787380264.592246:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec336ca80 x1874203867425280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380264.592254:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867425280:0@lo:400:kworker.0 00010000:00080000:0.0:1787380264.592373:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34efb80 x1874203867424128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380264.592392:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867424128:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787380264.592505:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5d9a680 x1874203867424256/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380264.592518:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867424256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380264.593112:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867425792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380264.593153:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380264.593238:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867425792 00000100:00100000:1.0:1787380264.593244:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867425792 00000100:00100000:1.0:1787380264.593332:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787380264.593341:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867425792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787380264.593380:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787380264.593438:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867425792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380264.593445:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787380264.593703:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867425792:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787380265.040045:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380265.100292:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787380265.100311:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867425920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380265.100371:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380265.100625:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380265.100633:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867426048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787380265.100659:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380265.100691:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867425920 00000100:00100000:1.0:1787380265.100698:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867425920 00000100:00100000:1.0:1787380265.100730:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867426048 00000100:00100000:1.0:1787380265.100732:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867426048 00000100:00100000:1.0:1787380265.100744:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787380265.100751:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867425920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787380265.100774:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380265.100830:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867425920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380265.100848:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787380265.100865:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787380265.100871:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867426048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787380265.100879:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380265.100906:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867426048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380265.100912:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787380265.100944:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34ec380 x1874203867426048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380265.100960:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867426048:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787380265.104508:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5d99880 x1874203867425920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380265.104531:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867425920:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787380265.575007:0:11220:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.116 00010000:00010000:1.0:1787380266.060018:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380266.124502:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380266.124525:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867426176:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787380266.124585:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380266.124691:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867426176 00000100:00100000:1.0:1787380266.124699:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867426176 00000100:00100000:1.0:1787380266.124748:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787380266.124756:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867426176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380266.124784:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380266.124853:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867426176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380266.124860:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787380266.124904:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867426176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787380266.146012:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380266.146050:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380266.146087:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380266.146168:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848483712 00000100:00100000:3.0:1787380266.146177:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848483712 00000100:00100000:0.0:1787380266.146202:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848483840 00000100:00100000:0.0:1787380266.146208:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848483840 00000100:00100000:3.0:1787380266.146243:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 281 00000100:00100000:3.0:1787380266.146254:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2400:x1874203848483712:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380266.146258:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848483968 00000100:00100000:0.0:1787380266.146262:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848483968 00000100:00100000:0.0:1787380266.146283:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 97 00000100:00100000:0.0:1787380266.146291:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2399:x1874203848483840:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380266.146319:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2400:x1874203848483712:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 66us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380266.146329:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2399:x1874203848483840:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 39us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380266.146342:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 97 00000100:00100000:3.0:1787380266.146347:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 281 00000100:00100000:0.0:1787380266.146361:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 98 00000100:00100000:0.0:1787380266.146368:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848483968:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380266.146392:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848483968:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 26us (305us total) trans 0 rc 0/0 00000100:00080000:1.0:1787380266.146505:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787380266.146510:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380266.146555:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 98 00000001:00100000:3.0:1787380266.647619:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000020:00000080:3.0:1787380266.647628:0:8429:0:(genops.c:906:class_export_put()) final put ffff9d6ff4ff8000/7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000020:00000080:0.0:1787380266.647678:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff4ff8000/7da54272-8859-4cb3-ba98-d1d4e18c7c38 for lustre-OST0000 00000020:00000080:0.0:1787380266.647724:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ff4ffa800 for lustre-OST0000 00000001:00100000:0.0:1787380266.660679:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000020:00000080:0.0:1787380266.660688:0:9514:0:(genops.c:906:class_export_put()) final put ffff9d6fff5ff000/7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000020:00000080:2.0:1787380266.660759:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fff5ff000/7da54272-8859-4cb3-ba98-d1d4e18c7c38 for lustre-OST0001 00000020:00000080:2.0:1787380266.660825:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6fff5fb000 for lustre-OST0001 00010000:00010000:2.0:1787380267.084176:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380268.109478:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787380268.489919:0:11318:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.116 00010000:00010000:1.0:1787380269.132534:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380269.709292:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867426304:0@lo:400:kworker.0 00000100:00100000:1.0:1787380269.709377:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380269.709393:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867426432:0@lo:400:kworker.0 00000100:00100000:2.0:1787380269.709440:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380269.709488:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867426944:0@lo:400:kworker.0 00000100:00100000:2.0:1787380269.709512:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380269.709539:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fff51a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867427456:0@lo:400:kworker.0 00000100:00100000:1.0:1787380269.709549:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867426816:0@lo:400:kworker.0 00000100:00100000:2.0:1787380269.709561:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380269.709587:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787380269.709590:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380269.709597:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867426560:0@lo:400:kworker.0 00000100:00100000:1.0:1787380269.709616:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fff519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867427328:0@lo:400:kworker.0 00000100:00100000:2.0:1787380269.709628:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380269.709648:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380269.709651:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fff518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867427072:0@lo:400:kworker.0 00000100:00100000:2.0:1787380269.709682:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380269.709683:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fff51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867427840:0@lo:400:kworker.0 00000100:00100000:2.0:1787380269.709703:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fff51aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867427584:0@lo:400:kworker.0 00000100:00100000:1.0:1787380269.709715:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380269.709734:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380269.709770:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867426432 00000100:00100000:2.0:1787380269.709778:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867426432 00000100:00100000:1.0:1787380269.709883:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787380269.709899:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867426688:0@lo:400:kworker.0 00000100:00100000:1.0:1787380269.709930:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380269.709948:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787380269.709959:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867427968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380269.709986:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380269.710006:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867426816 00000100:00100000:3.0:1787380269.710009:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867426816 00000100:00100000:1.0:1787380269.710021:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fff518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867427200:0@lo:400:kworker.0 00000100:00100000:3.0:1787380269.710040:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867426560 00000100:00100000:3.0:1787380269.710046:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867426560 00000100:00100000:1.0:1787380269.710052:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380269.710060:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867427968 00000100:00100000:3.0:1787380269.710064:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867427968 00000100:00100000:1.0:1787380269.710076:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fff519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867427712:0@lo:400:kworker.0 00000100:00100000:3.0:1787380269.710082:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787380269.710092:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867426816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380269.710101:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380269.710132:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867427328 00000100:00100000:1.0:1787380269.710136:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867427328 00000100:00100000:3.0:1787380269.710152:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867426816:12345-0@lo:400:kworker.0 Request processed in 61us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380269.710161:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787380269.710185:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787380269.710191:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1874203867426560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380269.710220:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1874203867426560:12345-0@lo:400:kworker.0 Request processed in 29us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380269.710226:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787380269.710237:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867427840 00000100:00100000:3.0:1787380269.710240:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787380269.710242:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867427840 00000100:00100000:3.0:1787380269.710249:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867427968:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787380269.710266:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867427200 00000100:00100000:1.0:1787380269.710269:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867427200 00000100:00100000:1.0:1787380269.710285:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867427712 00000004:00000024:3.0:1787380269.710287:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787380269.710288:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867427712 00000100:00100000:3.0:1787380269.710326:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867427968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380269.710339:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787380269.710369:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787380269.710442:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867426944 00000100:00100000:2.0:1787380269.710446:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867426944 00000100:00100000:1.0:1787380269.710454:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867427328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380269.710458:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867427456 00000100:00100000:2.0:1787380269.710461:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867427456 00000100:00100000:2.0:1787380269.710476:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867427072 00000100:00100000:2.0:1787380269.710479:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867427072 00000100:00100000:2.0:1787380269.710494:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867427584 00000100:00100000:2.0:1787380269.710497:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867427584 00000100:00100000:0.0:1787380269.710585:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867426688 00000100:00100000:0.0:1787380269.710595:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867426688 00000100:00100000:3.0:1787380269.711558:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867427968:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380269.711619:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867428096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787380269.711666:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380269.711712:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867426560:0@lo:400:kworker.0 00000100:00100000:3.0:1787380269.711736:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867426816:0@lo:400:kworker.0 00010000:00080000:3.0:1787380269.711747:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fff519500 x1874203867427328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380269.711756:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fff519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867427328:0@lo:400:kworker.0 00000100:00100000:3.0:1787380269.711789:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787380269.711797:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867427840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380269.711849:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867427840:12345-0@lo:400:kworker.0 Request processed in 53us (2134us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380269.711855:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787380269.711869:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787380269.711874:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867427200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380269.711896:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867427200:12345-0@lo:400:kworker.0 Request processed in 22us (1845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380269.711901:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787380269.711909:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787380269.711914:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867427712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380269.711932:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867427712:12345-0@lo:400:kworker.0 Request processed in 19us (1832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380269.711945:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787380269.716495:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787380269.716543:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787380269.716561:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867426944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380269.716597:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867426304 00000100:00100000:0.0:1787380269.716605:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867426304 00000100:00100000:3.0:1787380269.716651:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867426944:12345-0@lo:400:kworker.0 Request processed in 98us (7137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380269.716654:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787380269.716665:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787380269.716667:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3642:x1874203867426304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380269.716690:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787380269.716698:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867427456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380269.716718:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3642:x1874203867426304:12345-0@lo:400:kworker.0 Request processed in 53us (7340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380269.716725:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787380269.716738:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867427456:12345-0@lo:400:kworker.0 Request processed in 40us (7176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380269.716746:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787380269.716762:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787380269.716765:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867428224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380269.716773:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867427072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380269.716798:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380269.716849:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867426432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380269.716879:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867426432:12345-0@lo:400:kworker.0 Request processed in 370us (7439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380269.716886:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787380269.716900:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787380269.716907:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867426688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380269.716954:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867427072:12345-0@lo:400:kworker.0 Request processed in 183us (7270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380269.716956:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867426688:12345-0@lo:400:kworker.0 Request processed in 48us (7025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380269.716970:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787380269.717012:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867427328:12345-0@lo:400:kworker.0 Request processed in 121us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380269.717022:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787380269.717063:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787380269.717071:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787380269.717074:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787380269.717077:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787380269.717090:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867428096 00000100:00100000:1.0:1787380269.717095:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867428096 00000100:00100000:1.0:1787380269.717122:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867428224 00000100:00100000:1.0:1787380269.717125:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867428224 00000100:00100000:1.0:1787380269.717143:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787380269.717153:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec369b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867428096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787380269.717209:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380269.717262:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec369b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867428096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (5596us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380269.717269:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787380269.717281:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787380269.717287:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867428224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380269.717298:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380269.717337:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867428224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380269.717343:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787380269.717377:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3358000 x1874203867428224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380269.717395:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867428224:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787380269.717438:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5d99c00 x1874203867428096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380269.717450:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867428096:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1787380269.717498:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fff518e00 x1874203867427072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380269.717507:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fff518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867427072:0@lo:400:kworker.0 00000100:00100000:1.0:1787380269.717518:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867426432:0@lo:400:kworker.0 00000100:00100000:1.0:1787380269.717529:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867426944:0@lo:400:kworker.0 00000100:00100000:1.0:1787380269.717539:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fff51a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867427456:0@lo:400:kworker.0 00000100:00100000:1.0:1787380269.717589:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867426688:0@lo:400:kworker.0 00010000:00080000:1.0:1787380269.717601:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fff518700 x1874203867427200/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380269.717609:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fff518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867427200:0@lo:400:kworker.0 00010000:00080000:1.0:1787380269.717619:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fff519880 x1874203867427712/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380269.717626:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fff519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867427712:0@lo:400:kworker.0 00010000:00080000:1.0:1787380269.717636:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fff51ad80 x1874203867427840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380269.717642:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fff51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867427840:0@lo:400:kworker.0 00000100:00100000:1.0:1787380269.717650:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867426304:0@lo:400:kworker.0 00000100:00100000:0.0:1787380269.717889:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787380269.717907:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787380269.717920:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867427584:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1787380269.718008:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fff51aa00 x1874203867427584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380269.718017:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fff51aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867427584:0@lo:400:kworker.0 00000100:00100000:3.0:1787380269.718116:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867427584:12345-0@lo:400:kworker.0 Request processed in 50us (8232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380269.718128:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00010000:1.0:1787380270.155955:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380270.220097:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867428352:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380270.220172:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380270.220303:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867428352 00000100:00100000:0.0:1787380270.220311:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867428352 00000100:00100000:0.0:1787380270.220358:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787380270.220378:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec369a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867428352:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787380270.220405:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00002000:00000024:0.0:1787380270.220426:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380270.220431:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867428480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380270.220474:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380270.220490:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec369a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867428352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380270.220499:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787380270.220514:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867428480 00000100:00100000:0.0:1787380270.220517:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867428480 00000100:00100000:0.0:1787380270.220529:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787380270.220534:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867428480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380270.220544:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380270.220771:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867428480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 234us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380270.220778:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1787380270.220801:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec336f100 x1874203867428480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380270.220913:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867428480:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787380270.221021:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec336e680 x1874203867428352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380270.221036:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867428352:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1787380270.446666:0:11366:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Aug 22 02:31:09 EDT 2026 00010000:00010000:0.0:1787380271.180559:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380271.244031:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380271.244053:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867428608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787380271.244125:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380271.244327:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867428608 00000100:00100000:1.0:1787380271.244335:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867428608 00000100:00100000:1.0:1787380271.244383:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787380271.244391:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec369b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867428608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380271.244448:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380271.244503:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec369b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867428608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380271.244510:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787380271.244582:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867428608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787380271.261358:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380271.261397:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380271.261430:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380271.261453:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848484096 00000100:00100000:3.0:1787380271.261460:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848484096 00000100:00100000:3.0:1787380271.261501:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 283 00000100:00100000:3.0:1787380271.261508:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2400:x1874203848484096:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380271.261571:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2400:x1874203848484096:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 63us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380271.261578:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 283 00000100:00100000:3.0:1787380271.261613:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848484224 00000100:00100000:3.0:1787380271.261616:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848484224 00000100:00100000:3.0:1787380271.261642:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848484352 00000100:00100000:3.0:1787380271.261645:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848484352 00000100:00100000:3.0:1787380271.261661:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 105 00000100:00100000:3.0:1787380271.261666:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2400:x1874203848484224:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380271.261703:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2400:x1874203848484224:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 37us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380271.261709:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 105 00000100:00100000:3.0:1787380271.261721:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 106 00000100:00100000:3.0:1787380271.261726:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec369b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848484352:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380271.261744:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec369b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848484352:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 18us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380271.261760:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 106 00000100:00080000:0.0:1787380271.261917:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787380271.261921:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787380272.204104:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380273.230162:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380274.255930:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380274.828102:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fff519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867428736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380274.828180:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380274.828240:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787380274.828249:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec335a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867429248:0@lo:400:kworker.0 00000100:00100000:2.0:1787380274.828428:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380274.828439:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec335a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867428992:0@lo:400:kworker.0 00000100:00100000:2.0:1787380274.828452:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867428864:0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.828484:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380274.828493:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380274.828511:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867429504:0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.828535:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380274.828552:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867430016:0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.828572:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380274.828605:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787380274.828611:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867429120:0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.828630:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380274.828645:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867429632:0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.828666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380274.828687:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867430144:0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.828706:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380274.828737:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867428992 00000100:00100000:0.0:1787380274.828744:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867428992 00000100:00100000:0.0:1787380274.828774:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867429504 00000100:00100000:0.0:1787380274.828776:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867429504 00000100:00100000:0.0:1787380274.828797:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867430016 00000100:00100000:0.0:1787380274.828799:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867430016 00000100:00100000:0.0:1787380274.828857:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867429120 00000100:00100000:0.0:1787380274.828860:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867429120 00000100:00100000:0.0:1787380274.828874:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787380274.828883:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867428992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.828930:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867428992:12345-0@lo:400:kworker.0 Request processed in 48us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380274.828937:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787380274.828951:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787380274.828956:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867429504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.828982:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867429504:12345-0@lo:400:kworker.0 Request processed in 26us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380274.828987:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787380274.828997:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787380274.829001:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867430016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.829037:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867430016:12345-0@lo:400:kworker.0 Request processed in 35us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380274.829044:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787380274.829061:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787380274.829068:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867429120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380274.829073:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867429760:0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.829097:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867429120:12345-0@lo:400:kworker.0 Request processed in 29us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380274.829104:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787380274.829111:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380274.829136:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867430272:0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.829136:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867429632 00000100:00100000:0.0:1787380274.829141:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867429632 00000100:00100000:2.0:1787380274.829166:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380274.829172:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867430144 00000100:00100000:0.0:1787380274.829175:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867430144 00000100:00100000:2.0:1787380274.829184:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787380274.829190:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867429760 00000100:00100000:0.0:1787380274.829193:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867429760 00000100:00100000:2.0:1787380274.829194:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867429376:0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.829210:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867430272 00000100:00100000:0.0:1787380274.829214:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867430272 00000100:00100000:2.0:1787380274.829225:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380274.829230:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787380274.829237:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867429632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380274.829247:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867429888:0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.829381:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867429632:12345-0@lo:400:kworker.0 Request processed in 144us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380274.829388:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787380274.829410:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787380274.829416:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867430144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.829440:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867430144:12345-0@lo:400:kworker.0 Request processed in 25us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380274.829444:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787380274.829452:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787380274.829463:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867429760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.829486:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff519c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867429760:12345-0@lo:400:kworker.0 Request processed in 24us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380274.829491:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787380274.829500:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787380274.829504:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867430272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.829522:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867430272:12345-0@lo:400:kworker.0 Request processed in 18us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380274.829527:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1787380274.829543:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380274.829547:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787380274.829550:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787380274.829559:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867428864 00000100:00100000:0.0:1787380274.829563:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867428864 00000100:00100000:0.0:1787380274.829587:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787380274.829593:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867428864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.829621:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867428864:12345-0@lo:400:kworker.0 Request processed in 29us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380274.829626:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787380274.829796:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867429120:0@lo:400:kworker.0 00010000:00080000:0.0:1787380274.829839:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3c15c00 x1874203867429632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380274.829849:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867429632:0@lo:400:kworker.0 00010000:00080000:0.0:1787380274.829859:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3c15500 x1874203867430144/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380274.829878:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867430144:0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.829891:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec335a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867428992:0@lo:400:kworker.0 00010000:00080000:0.0:1787380274.829901:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3c15180 x1874203867429504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380274.829909:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867429504:0@lo:400:kworker.0 00010000:00080000:0.0:1787380274.829918:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3c14700 x1874203867430016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380274.829924:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867430016:0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.830060:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867429376 00000100:00100000:2.0:1787380274.830062:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380274.830065:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867429376 00000100:00100000:0.0:1787380274.830097:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867429888 00000100:00100000:0.0:1787380274.830101:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867429888 00010000:00080000:2.0:1787380274.830107:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3c17800 x1874203867429760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380274.830119:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867429760:0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.830122:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787380274.830132:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867429376:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787380274.830139:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3c16680 x1874203867430272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380274.830149:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867430272:0@lo:400:kworker.0 00000100:00100000:2.0:1787380274.830163:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867428864:0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.830171:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867429376:12345-0@lo:400:kworker.0 Request processed in 38us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380274.830178:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787380274.830188:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867429376:0@lo:400:kworker.0 00000100:00100000:0.0:1787380274.830194:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787380274.830205:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867429888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380274.830218:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867428736 00000100:00100000:2.0:1787380274.830223:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867428736 00000100:00100000:0.0:1787380274.830237:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867429888:12345-0@lo:400:kworker.0 Request processed in 35us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380274.830247:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867429248 00000100:00100000:2.0:1787380274.830545:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867429248 00000100:00100000:2.0:1787380274.830565:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787380274.830571:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867428736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787380274.830598:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787380274.830631:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867428736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (2452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380274.830638:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787380274.830650:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787380274.830656:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867429248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380274.830681:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867429248:12345-0@lo:400:kworker.0 Request processed in 26us (2255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380274.830688:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787380274.830725:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867429888:0@lo:400:kworker.0 00000100:00100000:2.0:1787380274.830748:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec335a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867429248:0@lo:400:kworker.0 00000100:00100000:2.0:1787380274.831074:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fff519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867428736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787380274.831427:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867430400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787380274.831468:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380274.832307:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867430400 00000100:00100000:2.0:1787380274.832314:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867430400 00000100:00100000:0.0:1787380274.832357:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787380274.832358:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787380274.832371:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867430400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787380274.832409:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787380274.832422:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380274.832460:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867430400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380274.832467:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1787380274.832506:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec336c000 x1874203867430400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380274.832522:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867430400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380274.832543:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380274.832551:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fff519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867430528:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380274.832577:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380274.832606:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867430528 00000100:00100000:2.0:1787380274.832609:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867430528 00000100:00100000:2.0:1787380274.832637:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787380274.832642:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff519880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867430528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787380274.832651:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380274.832675:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff519880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867430528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380274.832680:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1787380274.832700:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fff519f80 x1874203867430528/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380274.832716:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fff519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867430528:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1787380275.276130:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380275.340016:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380275.340037:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867430656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380275.340099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380275.340198:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867430656 00000100:00100000:1.0:1787380275.340206:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867430656 00000100:00100000:1.0:1787380275.340267:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787380275.340276:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec369aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867430656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787380275.340311:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380275.340366:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec369aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867430656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380275.340373:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1787380275.340426:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec336e300 x1874203867430656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380275.340445:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867430656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380275.342693:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380275.342712:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867430784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380275.342767:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380275.345188:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867430784 00000100:00100000:1.0:1787380275.345207:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867430784 00000100:00100000:1.0:1787380275.345283:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787380275.345299:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867430784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787380275.345325:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380275.345548:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867430784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 250us (2779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380275.345556:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787380275.345951:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec336e300 x1874203867430784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380275.345980:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867430784:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787380276.300245:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380276.364056:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380276.364079:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867430912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787380276.364144:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380276.364249:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867430912 00000100:00100000:0.0:1787380276.364257:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867430912 00000100:00100000:0.0:1787380276.364308:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787380276.364317:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867430912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787380276.364347:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787380276.364402:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867430912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380276.364409:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787380276.364526:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867430912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787380276.381600:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380276.381654:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380276.381677:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380276.381699:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848484480 00000100:00100000:3.0:1787380276.381707:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848484480 00000100:00100000:3.0:1787380276.381744:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 285 00000100:00100000:3.0:1787380276.381752:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2399:x1874203848484480:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380276.381805:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2399:x1874203848484480:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 54us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380276.381833:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 285 00000100:00100000:3.0:1787380276.381868:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848484608 00000100:00100000:3.0:1787380276.381872:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848484608 00000100:00100000:3.0:1787380276.381898:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848484736 00000100:00100000:3.0:1787380276.381900:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848484736 00000100:00100000:3.0:1787380276.381915:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 113 00000100:00100000:3.0:1787380276.381929:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2399:x1874203848484608:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380276.381963:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2399:x1874203848484608:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 34us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380276.381969:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 113 00000100:00100000:3.0:1787380276.381982:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 114 00000100:00100000:3.0:1787380276.381988:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848484736:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380276.382007:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848484736:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 20us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380276.382013:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 114 00000100:00080000:3.0:1787380276.382111:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787380276.382115:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787380277.324987:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380278.348276:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380279.372216:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380279.950772:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fff519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867431040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380279.950858:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380279.950910:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380279.950917:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fff518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867431168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380279.950942:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380279.950971:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fff51a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867431296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380279.956477:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867431680:0@lo:400:kworker.0 00000100:00100000:0.0:1787380279.956555:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867431552:0@lo:400:kworker.0 00000100:00100000:0.0:1787380279.956583:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380279.956613:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867432064:0@lo:400:kworker.0 00000100:00100000:0.0:1787380279.956634:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380279.956649:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867432576:0@lo:400:kworker.0 00000100:00100000:0.0:1787380279.956669:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380279.956702:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867431552 00000100:00100000:0.0:1787380279.956709:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867431552 00000100:00100000:0.0:1787380279.956744:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867432064 00000100:00100000:0.0:1787380279.956747:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867432064 00000100:00100000:0.0:1787380279.956765:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867432576 00000100:00100000:0.0:1787380279.956767:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867432576 00000100:00100000:0.0:1787380279.956782:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787380279.956789:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867431552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380279.956857:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867431552:12345-0@lo:400:kworker.0 Request processed in 67us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380279.956864:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787380279.956887:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787380279.956901:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec335a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867432064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380279.956931:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec335a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867432064:12345-0@lo:400:kworker.0 Request processed in 31us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380279.956937:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787380279.956948:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787380279.956954:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867432576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380279.956980:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867432576:12345-0@lo:400:kworker.0 Request processed in 26us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380279.956985:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1787380279.957009:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380279.957035:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867431552:0@lo:400:kworker.0 00000100:00100000:0.0:1787380279.957045:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867432064:0@lo:400:kworker.0 00000100:00100000:0.0:1787380279.957062:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867432576:0@lo:400:kworker.0 00000100:00100000:2.0:1787380279.957673:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380279.957730:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867431808:0@lo:400:kworker.0 00000100:00100000:2.0:1787380279.957765:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380279.957862:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867432320:0@lo:400:kworker.0 00000100:00100000:2.0:1787380279.957892:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380279.957926:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787380279.957935:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867431424:0@lo:400:kworker.0 00000100:00100000:2.0:1787380279.957966:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380279.957986:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867431936:0@lo:400:kworker.0 00000100:00100000:2.0:1787380279.958010:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380279.958029:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867432448:0@lo:400:kworker.0 00000100:00100000:2.0:1787380279.958050:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380279.958095:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867431040 00000100:00100000:2.0:1787380279.958101:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867431040 00000100:00100000:2.0:1787380279.958132:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867431168 00000100:00100000:2.0:1787380279.958135:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867431168 00000100:00100000:2.0:1787380279.958153:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787380279.958161:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867431040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787380279.958186:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380279.958224:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867431040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (7366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380279.958230:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787380279.958244:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787380279.958250:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867431168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787380279.958259:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380279.958284:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867431168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (7341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380279.958290:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787380279.958310:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867431296 00000100:00100000:2.0:1787380279.958313:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867431296 00000100:00100000:2.0:1787380279.958328:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867431936 00000100:00100000:2.0:1787380279.958330:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867431936 00000100:00100000:2.0:1787380279.958341:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787380279.958347:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867431296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787380279.958380:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787380279.958414:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867431296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380279.958420:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787380279.958432:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787380279.958437:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867431936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380279.958476:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867431936:12345-0@lo:400:kworker.0 Request processed in 39us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380279.958482:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787380279.960326:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867431936:0@lo:400:kworker.0 00000100:00100000:2.0:1787380279.960356:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fff51a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867431296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380279.960647:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867431808 00000100:00100000:0.0:1787380279.960655:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867431808 00000100:00100000:0.0:1787380279.960696:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787380279.960704:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867431808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380279.960783:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867431808:12345-0@lo:400:kworker.0 Request processed in 79us (3017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380279.960799:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787380279.960851:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867432320 00000100:00100000:0.0:1787380279.960856:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867432320 00000100:00100000:0.0:1787380279.960885:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867432448 00000100:00100000:0.0:1787380279.960889:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867432448 00000100:00100000:0.0:1787380279.960911:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787380279.960925:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867432320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380279.960978:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867432320:12345-0@lo:400:kworker.0 Request processed in 54us (3087us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380279.960985:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787380279.960998:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787380279.961004:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867432448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380279.961030:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867432448:12345-0@lo:400:kworker.0 Request processed in 27us (2979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380279.961036:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787380279.961055:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867431424 00000100:00100000:0.0:1787380279.961058:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867431424 00000100:00100000:0.0:1787380279.961081:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1787380279.961088:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867431424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380279.961131:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867431424:12345-0@lo:400:kworker.0 Request processed in 44us (3164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380279.961138:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:0.0:1787380279.961181:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787380279.961190:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787380279.961219:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fff518700 x1874203867431168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380279.961236:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fff518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867431168:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787380279.961249:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fff519f80 x1874203867431040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380279.961260:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fff519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867431040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380279.961288:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867431424:0@lo:400:kworker.0 00010000:00080000:0.0:1787380279.961311:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3c14700 x1874203867432448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380279.961321:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867432448:0@lo:400:kworker.0 00000100:00100000:0.0:1787380279.961333:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867431808:0@lo:400:kworker.0 00010000:00080000:0.0:1787380279.961342:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3c17b80 x1874203867432320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380279.961351:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867432320:0@lo:400:kworker.0 00000100:00100000:1.0:1787380279.961752:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380279.961787:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867432192:0@lo:400:kworker.0 00000100:00100000:1.0:1787380279.961856:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380279.961880:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1874203867432704:0@lo:400:kworker.0 00000100:00100000:1.0:1787380279.961902:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380279.961932:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867432192 00000100:00100000:1.0:1787380279.961936:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867432192 00000100:00100000:1.0:1787380279.961967:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867432704 00000100:00100000:1.0:1787380279.961970:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867432704 00000100:00100000:1.0:1787380279.961991:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787380279.961998:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867432192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380279.962036:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867432192:12345-0@lo:400:kworker.0 Request processed in 39us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380279.962043:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787380279.962056:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787380279.962062:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874203867432704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380279.962087:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874203867432704:12345-0@lo:400:kworker.0 Request processed in 26us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380279.962095:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1787380279.962115:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787380279.962137:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3c15f80 x1874203867432192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380279.962154:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867432192:0@lo:400:kworker.0 00010000:00080000:1.0:1787380279.962166:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3c16680 x1874203867432704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380279.962174:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1874203867432704:0@lo:400:kworker.0 00000100:00100000:1.0:1787380279.962194:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867431680 00000100:00100000:1.0:1787380279.962198:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867431680 00000100:00100000:1.0:1787380279.962226:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787380279.962232:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867431680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380279.962270:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867431680:12345-0@lo:400:kworker.0 Request processed in 38us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380279.962275:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787380279.962300:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867431680:0@lo:400:kworker.0 00010000:00010000:1.0:1787380280.396346:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380280.459972:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867432832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380280.460034:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380280.460476:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867432832 00000100:00100000:1.0:1787380280.460483:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867432832 00000100:00100000:0.0:1787380280.460697:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380280.460708:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867432960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380280.460736:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380280.461178:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867432960 00000100:00100000:1.0:1787380280.461184:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867432960 00000100:00100000:1.0:1787380280.461220:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787380280.461237:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867432832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787380280.461272:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380280.461337:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867432832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380280.461345:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787380280.461376:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787380280.461383:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec335a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867432960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787380280.461415:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1787380280.461434:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec336e680 x1874203867432832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380280.461453:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867432832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380280.461474:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec335a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867432960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (735us total) trans 0 rc 0/0 00010000:00080000:0.0:1787380280.461477:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5f09180 x1874203867432960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380280.461492:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867432960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787380280.461494:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:3.0:1787380281.422919:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380281.488198:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867433088:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787380281.488264:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380281.488401:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867433088 00000100:00100000:3.0:1787380281.488408:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867433088 00000100:00100000:3.0:1787380281.488459:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787380281.488468:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867433088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787380281.488500:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787380281.488955:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867433088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 486us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380281.488963:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787380281.490158:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867433088:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787380281.501020:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380281.501072:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380281.501104:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380281.501272:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848485120 00000100:00100000:1.0:1787380281.501281:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848485120 00000100:00100000:1.0:1787380281.501344:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848484992 00000100:00100000:1.0:1787380281.501347:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848484992 00000100:00100000:1.0:1787380281.501382:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 121 00000100:00100000:1.0:1787380281.501392:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848485120:12345-192.168.206.30@tcp:400:kworker.0 00000100:00080000:3.0:1787380281.501421:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787380281.501424:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787380281.501472:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848485120:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 81us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380281.501479:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 121 00000100:00100000:1.0:1787380281.501496:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 122 00000100:00100000:1.0:1787380281.501502:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2398:x1874203848484992:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380281.501526:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2398:x1874203848484992:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 25us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380281.501533:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 122 00000100:00100000:0.0:1787380281.501666:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848484864 00000100:00100000:0.0:1787380281.501676:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848484864 00000100:00100000:0.0:1787380281.501709:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 287 00000100:00100000:0.0:1787380281.501717:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2398:x1874203848484864:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380281.501744:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2398:x1874203848484864:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 28us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380281.501750:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 287 00010000:00010000:1.0:1787380282.444068:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380283.470638:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380284.494968:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787380284.539357:0:11995:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 02:31:23 (1787380283) === 00000100:00100000:0.0:1787380285.068109:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380285.068129:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867433216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380285.068201:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380285.068269:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867433216 00000100:00100000:0.0:1787380285.068284:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867433216 00000100:00100000:3.0:1787380285.068307:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380285.068321:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867433344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380285.068328:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787380285.068347:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867433216:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380285.068369:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1787380285.068379:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787380285.068414:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867433344 00000100:00100000:3.0:1787380285.068419:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867433344 00000100:00100000:0.0:1787380285.068424:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867433216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.068432:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787380285.068476:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787380285.068477:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867433216:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380285.068488:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867433344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787380285.068509:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1787380285.068510:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787380285.068580:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867433344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380285.068588:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787380285.069047:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867433856:0@lo:400:kworker.0 00000100:00100000:0.0:1787380285.069080:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380285.069123:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867434368:0@lo:400:kworker.0 00000100:00100000:0.0:1787380285.069147:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380285.069172:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867434880:0@lo:400:kworker.0 00000100:00100000:0.0:1787380285.069191:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380285.069231:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787380285.069238:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867433472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380285.069260:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380285.069276:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867433984:0@lo:400:kworker.0 00000100:00100000:0.0:1787380285.069295:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380285.069311:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867434496:0@lo:400:kworker.0 00000100:00100000:0.0:1787380285.069329:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380285.069365:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867434368 00000100:00100000:0.0:1787380285.069369:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867434368 00000100:00100000:0.0:1787380285.069398:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867434880 00000100:00100000:0.0:1787380285.069402:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867434880 00000100:00100000:0.0:1787380285.069415:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867434496 00000100:00100000:0.0:1787380285.069417:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867434496 00000100:00100000:0.0:1787380285.069428:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787380285.069434:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867434368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380285.069473:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867434368:12345-0@lo:400:kworker.0 Request processed in 38us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.069479:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787380285.069492:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787380285.069498:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867434880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380285.069524:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867434880:12345-0@lo:400:kworker.0 Request processed in 27us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.069530:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787380285.069539:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787380285.069708:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867434496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380285.069752:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867434496:12345-0@lo:400:kworker.0 Request processed in 206us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.069768:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787380285.069792:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867433472 00000100:00100000:0.0:1787380285.069796:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867433472 00000100:00100000:0.0:1787380285.069838:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787380285.069844:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867433472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787380285.069855:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380285.069883:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867433472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.069889:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787380285.069904:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867433984 00000100:00100000:0.0:1787380285.069908:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867433984 00000100:00100000:0.0:1787380285.069930:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787380285.069937:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867433984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380285.069966:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867433984:12345-0@lo:400:kworker.0 Request processed in 30us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.069972:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1787380285.069987:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380285.069990:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787380285.070017:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3686680 x1874203867433344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380285.070034:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867433344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380285.070057:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867433600:0@lo:400:kworker.0 00000100:00100000:0.0:1787380285.070098:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380285.070130:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867434112:0@lo:400:kworker.0 00000100:00100000:0.0:1787380285.070151:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380285.070179:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867434624:0@lo:400:kworker.0 00000100:00100000:2.0:1787380285.070183:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867433856 00000100:00100000:2.0:1787380285.070199:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867433856 00000100:00100000:0.0:1787380285.070204:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380285.070222:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787380285.070229:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867433728:0@lo:400:kworker.0 00000100:00100000:2.0:1787380285.070233:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867434112 00000100:00100000:2.0:1787380285.070237:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867434112 00000100:00100000:0.0:1787380285.070255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380285.070263:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867434624 00000100:00100000:2.0:1787380285.070267:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867434624 00000100:00100000:0.0:1787380285.070272:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867434240:0@lo:400:kworker.0 00000100:00100000:0.0:1787380285.070298:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380285.070299:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867433728 00000100:00100000:2.0:1787380285.070303:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867433728 00000100:00100000:0.0:1787380285.070313:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867434752:0@lo:400:kworker.0 00000100:00100000:2.0:1787380285.070316:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867434240 00000100:00100000:2.0:1787380285.070319:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867434240 00000100:00100000:2.0:1787380285.070350:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787380285.070354:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380285.070362:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867433856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380285.070386:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867433600 00000100:00100000:0.0:1787380285.070391:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867433600 00000100:00100000:2.0:1787380285.070415:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867433856:12345-0@lo:400:kworker.0 Request processed in 56us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380285.070423:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1787380285.070426:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1787380285.070435:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867433600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380285.070438:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867434752 00000100:00100000:2.0:1787380285.070443:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867434752 00000100:00100000:2.0:1787380285.070465:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787380285.070474:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867434112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380285.070480:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867433600:12345-0@lo:400:kworker.0 Request processed in 44us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.070487:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787380285.070512:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867434112:12345-0@lo:400:kworker.0 Request processed in 39us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380285.070521:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:0.0:1787380285.070535:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5da5880 x1874203867433472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380285.070544:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787380285.070552:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867434624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380285.070583:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867434624:12345-0@lo:400:kworker.0 Request processed in 31us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380285.070588:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787380285.070602:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787380285.070614:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867433728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380285.070660:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867433728:12345-0@lo:400:kworker.0 Request processed in 49us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380285.070678:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787380285.070687:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867434240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380285.070720:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867434240:12345-0@lo:400:kworker.0 Request processed in 35us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380285.070726:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787380285.070738:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787380285.070743:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867434752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380285.070765:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867434752:12345-0@lo:400:kworker.0 Request processed in 23us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380285.070771:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787380285.070933:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787380285.070979:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867433728:0@lo:400:kworker.0 00010000:00080000:1.0:1787380285.070990:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5da7100 x1874203867434240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380285.071000:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867434240:0@lo:400:kworker.0 00010000:00080000:1.0:1787380285.071008:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5da5180 x1874203867434752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380285.071016:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867434752:0@lo:400:kworker.0 00000100:00100000:1.0:1787380285.071022:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867433600:0@lo:400:kworker.0 00000100:00100000:1.0:1787380285.071030:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867434112:0@lo:400:kworker.0 00000100:00100000:1.0:1787380285.071038:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867434624:0@lo:400:kworker.0 00000100:00100000:0.0:1787380285.074473:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867433472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380285.074552:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867433984:0@lo:400:kworker.0 00010000:00080000:0.0:1787380285.074614:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5da5f80 x1874203867434496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380285.074625:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867434496:0@lo:400:kworker.0 00000100:00100000:0.0:1787380285.074638:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867433856:0@lo:400:kworker.0 00010000:00080000:0.0:1787380285.074669:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5da4380 x1874203867434368/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380285.074678:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867434368:0@lo:400:kworker.0 00010000:00080000:0.0:1787380285.074688:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5da5c00 x1874203867434880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380285.074696:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867434880:0@lo:400:kworker.0 00000100:00080000:2.0:1787380285.076325:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787380285.076333:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380285.396317:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380285.396482:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848485248 00000100:00100000:1.0:1787380285.396492:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848485248 00000100:00100000:1.0:1787380285.396549:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 289 00000100:00100000:1.0:1787380285.396559:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+10:8714:x1874203848485248:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787380285.396573:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380285.396592:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad68ddd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ab61 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380285.396683:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad68ddd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab61 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380285.396696:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad68ddd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab61 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380285.396722:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc165b200, rc 0) 00000100:00100000:1.0:1787380285.396781:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+11:8714:x1874203848485248:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 223us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380285.396788:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 289 00000100:00100000:3.0:1787380285.401173:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380285.401548:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848485376 00000100:00100000:0.0:1787380285.401557:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848485376 00000100:00100000:0.0:1787380285.401648:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 290 00000100:00100000:0.0:1787380285.401657:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+11:8714:x1874203848485376:12345-192.168.206.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787380285.401802:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+11:8714:x1874203848485376:12345-192.168.206.30@tcp:501:mount.lustre.0 Request processed in 146us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.401915:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 290 00000100:00100000:3.0:1787380285.404566:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380285.406768:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848485504 00000100:00100000:0.0:1787380285.406782:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848485504 00000100:00100000:0.0:1787380285.406918:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 291 00000100:00100000:0.0:1787380285.406928:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+11:8714:x1874203848485504:12345-192.168.206.30@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787380285.407079:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+11:8714:x1874203848485504:12345-192.168.206.30@tcp:503:mount.lustre.0 Request processed in 151us (2519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.407087:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 291 00000100:00100000:3.0:1787380285.416599:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380285.418324:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848485632 00000100:00100000:0.0:1787380285.418349:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848485632 00000100:00100000:0.0:1787380285.418426:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 292 00000100:00100000:0.0:1787380285.418446:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+11:8718:x1874203848485632:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787380285.418626:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+11:8718:x1874203848485632:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 181us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.418635:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 292 00000100:00100000:3.0:1787380285.459202:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380285.459379:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848485760 00000100:00100000:0.0:1787380285.459389:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848485760 00000100:00100000:0.0:1787380285.459584:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 293 00000100:00100000:0.0:1787380285.459594:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+11:8718:x1874203848485760:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787380285.459747:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+11:8718:x1874203848485760:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 155us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.459756:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 293 00000100:00100000:3.0:1787380285.463833:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380285.464022:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848485888 00000100:00100000:1.0:1787380285.464032:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848485888 00000100:00100000:1.0:1787380285.464124:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 294 00000100:00100000:1.0:1787380285.464134:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+11:8718:x1874203848485888:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787380285.464296:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+11:8718:x1874203848485888:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 163us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380285.464304:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 294 00000100:00100000:3.0:1787380285.467320:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380285.467460:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848486016 00000100:00100000:0.0:1787380285.467469:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848486016 00000100:00100000:0.0:1787380285.467525:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 295 00000100:00100000:0.0:1787380285.467535:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+11:8714:x1874203848486016:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787380285.467549:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380285.467565:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7866e00/0xcf3c46fdcad68de4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ab92 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380285.467592:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7866e00/0xcf3c46fdcad68de4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab92 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380285.467603:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7866e00/0xcf3c46fdcad68de4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab92 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380285.467612:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866e00, rc 0) 00000100:00100000:0.0:1787380285.467764:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+12:8714:x1874203848486016:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 230us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.467783:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 295 00000100:00100000:3.0:1787380285.470977:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380285.471138:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848486144 00000100:00100000:1.0:1787380285.471147:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848486144 00000100:00100000:1.0:1787380285.471237:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 296 00000100:00100000:1.0:1787380285.471247:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+12:8714:x1874203848486144:12345-192.168.206.30@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787380285.471270:0:6515:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787380285.471292:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787380285.471296:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787380285.471304:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787380285.471307:0:6515:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787380285.471309:0:6515:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1787380285.478159:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+12:8714:x1874203848486144:12345-192.168.206.30@tcp:256:mount.lustre.0 Request processed in 6903us (7178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380285.478174:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 296 00000100:00100000:3.0:1787380285.480593:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380285.480677:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848486272 00000100:00100000:0.0:1787380285.480685:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848486272 00000100:00100000:0.0:1787380285.480745:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 297 00000100:00100000:0.0:1787380285.480754:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+12:8714:x1874203848486272:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787380285.480768:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380285.480783:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad68deb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ab99 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380285.480830:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad68deb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab99 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380285.480840:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad68deb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab99 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380285.480848:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867000, rc 0) 00000100:00100000:0.0:1787380285.480900:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:8714:x1874203848486272:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 146us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.480908:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 297 00000100:00100000:3.0:1787380285.483308:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380285.483398:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848486400 00000100:00100000:1.0:1787380285.483418:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848486400 00000100:00100000:1.0:1787380285.483474:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 298 00000100:00100000:1.0:1787380285.483484:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:8714:x1874203848486400:12345-192.168.206.30@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787380285.483613:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:8714:x1874203848486400:12345-192.168.206.30@tcp:501:mount.lustre.0 Request processed in 131us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380285.483620:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 298 00000100:00100000:3.0:1787380285.485346:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380285.485405:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848486528 00000100:00100000:2.0:1787380285.485413:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848486528 00000100:00100000:2.0:1787380285.485463:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 299 00000100:00100000:2.0:1787380285.485472:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:8714:x1874203848486528:12345-192.168.206.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787380285.485595:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:8714:x1874203848486528:12345-192.168.206.30@tcp:503:mount.lustre.0 Request processed in 123us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380285.485603:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 299 00000100:00100000:3.0:1787380285.487611:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380285.488042:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848486656 00000100:00100000:0.0:1787380285.488051:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848486656 00000100:00100000:0.0:1787380285.488488:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 300 00000100:00100000:0.0:1787380285.488497:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:8722:x1874203848486656:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787380285.488635:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:8722:x1874203848486656:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 138us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.488642:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 300 00000100:00100000:3.0:1787380285.490866:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380285.490977:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848486784 00000100:00100000:2.0:1787380285.490985:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848486784 00000100:00100000:2.0:1787380285.491052:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 301 00000100:00100000:2.0:1787380285.491060:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:8722:x1874203848486784:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787380285.491264:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:8722:x1874203848486784:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 204us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380285.491272:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 301 00000100:00100000:3.0:1787380285.495932:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380285.496012:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380285.498926:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848487552 00000100:00100000:2.0:1787380285.498938:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848487552 00000100:00100000:3.0:1787380285.498979:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00080000:1.0:1787380285.499216:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380285.499467:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380285.499628:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848487680 00000100:00100000:0.0:1787380285.499634:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848487680 00000100:00100000:2.0:1787380285.499663:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848486912 00000100:00100000:2.0:1787380285.499669:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848486912 00000100:00100000:0.0:1787380285.499670:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 129 00000100:00100000:0.0:1787380285.499682:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2399:x1874203848487552:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380285.499692:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:2.0:1787380285.499699:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2396:x1874203848486912:12345-192.168.206.30@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787380285.499721:0:10154:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from bd549a2a-de1a-4b9c-be02-339b2f6be909@192.168.206.30@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:2.0:1787380285.499757:0:10154:0:(genops.c:1406:class_connect()) connect: client bd549a2a-de1a-4b9c-be02-339b2f6be909, cookie 0xcf3c46fdcad68df2 00000004:00100000:2.0:1787380285.499778:0:10154:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787380285.499823:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2399:x1874203848487552:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 127us (3882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.499832:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 129 00000100:00100000:0.0:1787380285.499852:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 130 00000100:00100000:0.0:1787380285.499860:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848487680:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380285.499889:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848487680:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 30us (3876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.499896:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 130 00000100:00080000:2.0:1787380285.499903:0:10154:0:(import.c:65:import_set_state_nolock()) ffff9d6ec376e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787380285.499935:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2396:x1874203848486912:12345-192.168.206.30@tcp:38:mount.lustre.0 Request processed in 235us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380285.499942:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:0.0:1787380285.500069:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848487168 00000100:00100000:0.0:1787380285.500074:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848487168 00000100:00100000:0.0:1787380285.500114:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:0.0:1787380285.500121:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1874203848487168:12345-192.168.206.30@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787380285.500137:0:6521:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from bd549a2a-de1a-4b9c-be02-339b2f6be909@192.168.206.30@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:0.0:1787380285.500159:0:6521:0:(genops.c:1406:class_connect()) connect: client bd549a2a-de1a-4b9c-be02-339b2f6be909, cookie 0xcf3c46fdcad68df9 00000004:00100000:0.0:1787380285.500171:0:6521:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787380285.500226:0:6521:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2622800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787380285.500261:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2396:x1874203848487168:12345-192.168.206.30@tcp:38:mount.lustre.0 Request processed in 139us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.500267:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00080000:1.0:1787380285.500536:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787380285.502164:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380285.502200:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380285.502278:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848487296 00000100:00100000:2.0:1787380285.502286:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848487296 00000100:00080000:1.0:1787380285.502434:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787380285.502619:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848487040 00000100:00100000:2.0:1787380285.502624:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848487040 00000100:00080000:1.0:1787380285.502683:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380285.503846:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:3.0:1787380285.503862:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:0:x1874203848487296:12345-192.168.206.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787380285.503895:0:10154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787380285.504015:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:0.0:1787380285.504024:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:0:x1874203848487040:12345-192.168.206.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787380285.504051:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787380285.504395:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:0:x1874203848487296:12345-192.168.206.30@tcp:41:mount.lustre.0 Request processed in 537us (2234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380285.504403:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:0.0:1787380285.504957:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:0:x1874203848487040:12345-192.168.206.30@tcp:41:mount.lustre.0 Request processed in 932us (2753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.504964:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:1.0:1787380285.505252:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380285.505784:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848487424 00000100:00100000:3.0:1787380285.505791:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848487424 00000100:00100000:3.0:1787380285.505855:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:3.0:1787380285.505863:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:8714:x1874203848487424:12345-192.168.206.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787380285.505883:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787380285.505931:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:8714:x1874203848487424:12345-192.168.206.30@tcp:41:mount.lustre.0 Request processed in 70us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380285.505938:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:2.0:1787380285.509372:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380285.511262:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848487808 00000100:00100000:3.0:1787380285.511274:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848487808 00000100:00100000:2.0:1787380285.511944:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:2.0:1787380285.511954:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:8714:x1874203848487808:12345-192.168.206.30@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787380285.512039:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:8714:x1874203848487808:12345-192.168.206.30@tcp:40:mount.lustre.0 Request processed in 86us (2675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380285.512059:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 21 00010000:00010000:1.0:1787380285.516058:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380285.516804:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380285.516960:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380285.516990:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380285.517071:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848487936 00000100:00100000:0.0:1787380285.517081:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848487936 00000100:00100000:0.0:1787380285.517127:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848488064 00000100:00100000:0.0:1787380285.517131:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848488064 00000100:00100000:0.0:1787380285.517151:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:0.0:1787380285.517159:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2396:x1874203848487936:12345-192.168.206.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787380285.517189:0:8436:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from bd549a2a-de1a-4b9c-be02-339b2f6be909@192.168.206.30@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:0.0:1787380285.517216:0:8436:0:(genops.c:1406:class_connect()) connect: client bd549a2a-de1a-4b9c-be02-339b2f6be909, cookie 0xcf3c46fdcad68e00 00002000:00100000:0.0:1787380285.517227:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bd549a2a-de1a-4b9c-be02-339b2f6be909/ffff9d6ec2626800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787380285.517243:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787380285.517306:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787380285.517331:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2626000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787380285.517396:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2396:x1874203848487936:12345-192.168.206.30@tcp:8:mount.lustre.0 Request processed in 236us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.517404:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:0.0:1787380285.517421:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:0.0:1787380285.517425:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2396:x1874203848488064:12345-192.168.206.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787380285.517441:0:8436:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from bd549a2a-de1a-4b9c-be02-339b2f6be909@192.168.206.30@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:0.0:1787380285.517459:0:8436:0:(genops.c:1406:class_connect()) connect: client bd549a2a-de1a-4b9c-be02-339b2f6be909, cookie 0xcf3c46fdcad68e07 00002000:00100000:0.0:1787380285.517464:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bd549a2a-de1a-4b9c-be02-339b2f6be909/ffff9d6ff4ff8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787380285.517482:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787380285.517517:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787380285.517533:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9d6ff4ffa800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787380285.517556:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2607800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2396:x1874203848488064:12345-192.168.206.30@tcp:8:mount.lustre.0 Request processed in 129us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.517562:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:3.0:1787380285.518987:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848488192 00000100:00100000:3.0:1787380285.518996:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848488192 00000100:00100000:2.0:1787380285.519328:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:2.0:1787380285.519350:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:8714:x1874203848488192:12345-192.168.206.30@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787380285.519473:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:8714:x1874203848488192:12345-192.168.206.30@tcp:900:mount.lustre.0 Request processed in 125us (2673us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380285.519481:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:1.0:1787380285.522234:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380285.522310:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848488320 00000100:00100000:3.0:1787380285.522318:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848488320 00000100:00100000:3.0:1787380285.522422:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00100000:3.0:1787380285.522431:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:8714:x1874203848488320:12345-192.168.206.30@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787380285.522522:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787380285.522613:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2604700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:8714:x1874203848488320:12345-192.168.206.30@tcp:33:mount.lustre.0 Request processed in 183us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380285.522620:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00100000:2.0:1787380285.580565:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787380285.581106:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380285.581124:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec2604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867435136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787380285.581185:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380285.581307:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec36d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867435008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380285.581308:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867435136 00000100:00100000:0.0:1787380285.581317:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867435136 00000100:00100000:2.0:1787380285.581357:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380285.581384:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867435008 00000100:00100000:0.0:1787380285.581390:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867435008 00000100:00100000:0.0:1787380285.581411:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787380285.581420:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867435136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787380285.581445:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380285.581584:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867435136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 164us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.581591:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787380285.581608:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787380285.581614:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867435008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380285.581624:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380285.581663:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867435008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380285.581669:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1787380285.581834:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec2604a80 x1874203867435136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380285.581851:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec2604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867435136:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1787380285.581969:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec36d4e00 x1874203867435008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380285.581984:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec36d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867435008:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787380286.544591:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380286.604199:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867435264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787380286.604265:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380286.604345:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867435264 00000100:00100000:3.0:1787380286.604352:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867435264 00000100:00100000:3.0:1787380286.604392:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787380286.604400:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867435264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787380286.604430:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787380286.604471:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867435264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380286.604478:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787380286.604530:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867435264:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787380287.570483:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380288.587991:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380289.612585:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380290.188187:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867435392:0@lo:400:kworker.0 00000100:00100000:3.0:1787380290.188320:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380290.188404:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867435392 00000100:00100000:1.0:1787380290.188412:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867435392 00000100:00100000:1.0:1787380290.188703:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1787380290.188714:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867435392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380290.193177:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867435520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380290.193240:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380290.193279:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867436032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380290.193348:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380290.193376:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380290.193383:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867435904:0@lo:400:kworker.0 00000100:00100000:0.0:1787380290.193414:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380290.193451:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867435520 00000100:00100000:0.0:1787380290.193458:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867435520 00000100:00100000:0.0:1787380290.193511:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787380290.193520:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867435520:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787380290.193591:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867435392:12345-0@lo:400:kworker.0 Request processed in 4877us (5280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380290.193603:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:1.0:1787380290.193641:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787380290.193656:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867436544:0@lo:400:kworker.0 00000100:00100000:1.0:1787380290.193672:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867436032 00000100:00100000:1.0:1787380290.193683:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867436032 00000100:00100000:2.0:1787380290.193693:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380290.193708:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867435904 00000100:00100000:1.0:1787380290.193713:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867435904 00000100:00100000:2.0:1787380290.193721:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867437056:0@lo:400:kworker.0 00000100:00100000:1.0:1787380290.193728:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787380290.193737:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1874203867436032:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380290.193748:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1787380290.193764:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787380290.193784:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787380290.193792:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1874203867436416:0@lo:400:kworker.0 00000100:00100000:1.0:1787380290.193827:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3642:x1874203867436032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380290.193836:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380290.193847:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787380290.193863:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787380290.193871:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867435904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380290.193873:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1874203867436928:0@lo:400:kworker.0 00000100:00100000:1.0:1787380290.193915:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867435904:12345-0@lo:400:kworker.0 Request processed in 45us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380290.193922:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787380290.193932:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380290.193952:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867436544 00000100:00100000:1.0:1787380290.193956:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867436544 00000100:00100000:2.0:1787380290.193980:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867435904:0@lo:400:kworker.0 00000100:00100000:2.0:1787380290.193996:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867436032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380290.194024:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867437056 00000100:00100000:2.0:1787380290.194028:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867437056 00000100:00100000:2.0:1787380290.194052:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867436416 00000100:00100000:2.0:1787380290.194055:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867436416 00002000:00000024:0.0:1787380290.194060:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380290.194070:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867436928 00000100:00100000:2.0:1787380290.194074:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867436928 00000100:00100000:2.0:1787380290.194093:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787380290.194102:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867437056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380290.194108:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867435520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 588us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380290.194116:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787380290.194140:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787380290.194146:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867437056:12345-0@lo:400:kworker.0 Request processed in 45us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380290.194151:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874203867436416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380290.194158:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787380290.194177:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787380290.194185:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874203867436928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380290.194192:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874203867436416:12345-0@lo:400:kworker.0 Request processed in 44us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380290.194200:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787380290.194222:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874203867436928:12345-0@lo:400:kworker.0 Request processed in 38us (292us total) trans 0 rc 0/0 00000100:00080000:0.0:1787380290.194228:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380290.194232:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1787380290.194234:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787380290.194269:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867435776:0@lo:400:kworker.0 00000100:00100000:2.0:1787380290.194275:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1874203867436416:0@lo:400:kworker.0 00000100:00100000:2.0:1787380290.194288:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1874203867436928:0@lo:400:kworker.0 00000100:00100000:0.0:1787380290.194302:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787380290.194303:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5da6a00 x1874203867437056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380290.194336:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867436288:0@lo:400:kworker.0 00000100:00100000:0.0:1787380290.194357:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380290.194371:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867436800:0@lo:400:kworker.0 00000100:00100000:0.0:1787380290.194391:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380290.194407:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1787380290.194420:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867435648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380290.194443:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380290.194460:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867436160:0@lo:400:kworker.0 00000100:00100000:0.0:1787380290.194479:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380290.194495:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867436672:0@lo:400:kworker.0 00000100:00100000:0.0:1787380290.194514:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380290.194530:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec2604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867437184:0@lo:400:kworker.0 00000100:00100000:0.0:1787380290.194546:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380290.194571:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867435776 00000100:00100000:0.0:1787380290.194575:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867435776 00000100:00100000:0.0:1787380290.194594:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867436160 00000100:00100000:0.0:1787380290.194597:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867436160 00000100:00100000:0.0:1787380290.194610:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787380290.194616:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867435776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380290.194648:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867435776:12345-0@lo:400:kworker.0 Request processed in 32us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380290.194663:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787380290.194669:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867437056:0@lo:400:kworker.0 00000100:00100000:0.0:1787380290.194680:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787380290.194688:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867436160:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1787380290.194691:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff4f20e00 x1874203867435520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380290.194721:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867435520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380290.194723:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867436160:12345-0@lo:400:kworker.0 Request processed in 36us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380290.194733:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787380290.194760:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867436672 00000100:00100000:0.0:1787380290.194760:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867436800 00000100:00100000:0.0:1787380290.194764:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867436800 00000100:00100000:2.0:1787380290.194766:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867436672 00000100:00100000:0.0:1787380290.194797:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867437184 00000100:00100000:1.0:1787380290.194939:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787380290.194946:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867436544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380290.195362:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867437184 00000100:00100000:0.0:1787380290.195910:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787380290.195928:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867436800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380290.195967:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787380290.195976:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867436672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380290.196107:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867435392:0@lo:400:kworker.0 00000100:00100000:3.0:1787380290.196159:0:8871:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787380290.196167:0:8871:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1787380290.196202:0:8435:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787380290.196210:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787380290.196217:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867437184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380290.196264:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867437184:12345-0@lo:400:kworker.0 Request processed in 46us (1716us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380290.196271:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787380290.196290:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867435648 00000100:00100000:3.0:1787380290.196294:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867435648 00000100:00100000:3.0:1787380290.196374:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787380290.196381:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867435648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787380290.196394:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380290.196506:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867435648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (2060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380290.196513:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787380290.196537:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867436288 00000100:00100000:3.0:1787380290.196541:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867436288 00000100:00100000:3.0:1787380290.196563:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787380290.196569:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867436288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380290.196600:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867436288:12345-0@lo:400:kworker.0 Request processed in 31us (2243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380290.196606:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1787380290.196639:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787380290.196644:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787380290.196664:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec361ce00 x1874203867435648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380290.196680:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867435648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380290.196691:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867436160:0@lo:400:kworker.0 00010000:00080000:3.0:1787380290.196700:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec2604a80 x1874203867437184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380290.196721:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec2604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867437184:0@lo:400:kworker.0 00000100:00100000:3.0:1787380290.196734:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867435776:0@lo:400:kworker.0 00000100:00100000:3.0:1787380290.196743:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867436288:0@lo:400:kworker.0 00000100:00100000:1.0:1787380290.196849:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867436544:12345-0@lo:400:kworker.0 Request processed in 1902us (3154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380290.196858:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00010000:00080000:1.0:1787380290.197027:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5da6d80 x1874203867436544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380290.197038:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867436544:0@lo:400:kworker.0 00000100:00100000:0.0:1787380290.197643:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867436800:12345-0@lo:400:kworker.0 Request processed in 1715us (3249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380290.197651:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1787380290.197711:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5da7100 x1874203867436800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380290.197721:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867436800:0@lo:400:kworker.0 00000100:00100000:2.0:1787380290.198535:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867436672:12345-0@lo:400:kworker.0 Request processed in 2557us (4015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380290.198546:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1787380290.199048:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5da5180 x1874203867436672/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380290.199061:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867436672:0@lo:400:kworker.0 00010000:00010000:0.0:1787380290.636023:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380290.699980:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867437312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380290.700046:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380290.700144:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867437312 00000100:00100000:1.0:1787380290.700151:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867437312 00000100:00100000:1.0:1787380290.700202:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787380290.700219:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867437312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787380290.700244:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380290.700298:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867437312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380290.700315:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1787380290.700367:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec361dc00 x1874203867437312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380290.700387:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867437312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380290.700655:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380290.700730:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867437440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380290.700763:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380290.701004:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867437440 00000100:00100000:1.0:1787380290.701009:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867437440 00000100:00100000:1.0:1787380290.701074:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787380290.701082:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867437440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787380290.701094:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380290.701126:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867437440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380290.701132:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1787380290.701188:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec361fb80 x1874203867437440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380290.701204:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867437440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380290.725246:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380290.725325:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380290.725415:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380290.725450:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380290.725476:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380290.728663:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848488576 00000100:00100000:0.0:1787380290.728677:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848488576 00000100:00100000:3.0:1787380290.728716:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380290.728768:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380290.728796:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848489088 00000100:00100000:3.0:1787380290.728801:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848489088 00000100:00100000:3.0:1787380290.728857:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848489216 00000100:00100000:3.0:1787380290.728861:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848489216 00000100:00100000:3.0:1787380290.728890:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 55 00000100:00100000:0.0:1787380290.728891:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848488832 00000100:00100000:0.0:1787380290.728897:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848488832 00000100:00100000:3.0:1787380290.728902:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2398:x1874203848489088:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380290.728916:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848488704 00000100:00100000:0.0:1787380290.728919:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848488704 00000100:00100000:0.0:1787380290.728933:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848488960 00000100:00100000:0.0:1787380290.728935:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848488960 00000100:00100000:0.0:1787380290.728953:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 137 00000100:00100000:0.0:1787380290.728961:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2398:x1874203848488576:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380290.728989:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2398:x1874203848489088:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 89us (3572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380290.729003:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2398:x1874203848488576:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 41us (3761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380290.729012:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 55 00000100:00100000:0.0:1787380290.729016:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 137 00000100:00100000:0.0:1787380290.729039:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 138 00000100:00100000:3.0:1787380290.729044:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 56 00000100:00100000:0.0:1787380290.729050:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2398:x1874203848488832:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380290.729057:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2398:x1874203848489216:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380290.729083:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2398:x1874203848488832:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 37us (3757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380290.729095:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2604a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2398:x1874203848489216:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 41us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380290.729105:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 56 00000100:00100000:3.0:1787380290.729125:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848488448 00000100:00100000:3.0:1787380290.729128:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848488448 00000100:00100000:3.0:1787380290.729149:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 303 00000100:00100000:3.0:1787380290.729155:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2398:x1874203848488448:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380290.729177:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2398:x1874203848488448:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 22us (3726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380290.729183:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 303 00000100:00100000:3.0:1787380290.729211:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 139 00000100:00100000:3.0:1787380290.729218:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848488704:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380290.729243:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848488704:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 26us (3767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380290.729248:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 139 00000100:00100000:3.0:1787380290.729260:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 140 00000100:00100000:0.0:1787380290.729353:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 138 00000100:00080000:0.0:1787380290.729376:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787380290.729380:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380290.729382:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787380290.729384:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380290.730084:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2398:x1874203848488960:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380290.730266:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2398:x1874203848488960:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 998us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380290.730274:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 140 00000001:02000400:2.0:1787380291.179265:0:12189:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1787380291.672016:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787380291.725752:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bd549a2a-de1a-4b9c-be02-339b2f6be909 00000100:00100000:1.0:1787380291.726123:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787380291.726142:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867437568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787380291.726198:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380291.726258:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867437568 00000100:00100000:1.0:1787380291.726265:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867437568 00000100:00100000:1.0:1787380291.726318:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787380291.726327:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867437568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380291.726361:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380291.726418:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867437568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380291.726425:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787380291.726469:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867437568:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1787380291.731652:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bd549a2a-de1a-4b9c-be02-339b2f6be909 00000001:00100000:2.0:1787380291.732312:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd549a2a-de1a-4b9c-be02-339b2f6be909 00000001:00100000:1.0:1787380291.746280:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bd549a2a-de1a-4b9c-be02-339b2f6be909 00010000:00010000:1.0:1787380292.687804:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380293.707996:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380294.733923:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380295.307969:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867437696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380295.308033:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380295.308251:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380295.308260:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867437824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787380295.308342:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380295.308372:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867437824 00000100:00100000:1.0:1787380295.308379:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867437824 00000100:00100000:1.0:1787380295.308421:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787380295.308430:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867437824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787380295.308462:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787380295.308505:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867437824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380295.308512:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787380295.308554:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867437824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380295.308715:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867437696 00000100:00100000:0.0:1787380295.308720:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867437696 00000100:00100000:0.0:1787380295.308771:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787380295.308779:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867437696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787380295.308796:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380295.308859:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867437696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380295.308865:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787380295.308935:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380295.308944:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867437952:0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.308980:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380295.309023:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867438080:0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.309066:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380295.309105:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867438080 00000100:00100000:0.0:1787380295.309109:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867438080 00000100:00100000:0.0:1787380295.309132:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787380295.309139:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867438080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.309176:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867438080:12345-0@lo:400:kworker.0 Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380295.309197:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787380295.309237:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867438080:0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.309272:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380295.309292:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867438208:0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.309318:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380295.309356:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867438336:0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.309383:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380295.309417:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380295.309423:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1874203867438464:0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.309458:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380295.309484:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867438208 00000100:00100000:0.0:1787380295.309488:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867438208 00000100:00100000:0.0:1787380295.309507:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867438464 00000100:00100000:0.0:1787380295.309510:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867438464 00000100:00100000:0.0:1787380295.309524:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787380295.309529:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867438208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.309563:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867438208:12345-0@lo:400:kworker.0 Request processed in 33us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380295.309569:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787380295.309580:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787380295.309587:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874203867438464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.309619:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874203867438464:12345-0@lo:400:kworker.0 Request processed in 33us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380295.309625:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787380295.309650:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867438208:0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.309682:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1874203867438464:0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.309715:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867438592:0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.309738:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380295.309760:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867438592 00000100:00100000:0.0:1787380295.309764:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867438592 00000100:00100000:0.0:1787380295.309785:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787380295.309792:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867438592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.309844:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867438592:12345-0@lo:400:kworker.0 Request processed in 52us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380295.309851:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00010000:00080000:0.0:1787380295.309875:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3dae680 x1874203867438592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380295.309886:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867438592:0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.309916:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380295.309923:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867438720:0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.309946:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380295.309971:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867438720 00000100:00100000:0.0:1787380295.309975:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867438720 00000100:00100000:0.0:1787380295.310002:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787380295.310009:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3dad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867438720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.310042:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3dad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867438720:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380295.310047:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1787380295.310073:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3dae680 x1874203867438720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380295.310095:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867438720:0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.310127:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867438848:0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.310149:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380295.310174:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867438848 00000100:00100000:0.0:1787380295.310177:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867438848 00000100:00100000:0.0:1787380295.310200:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787380295.310205:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3daed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867438848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.310237:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3daed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867438848:12345-0@lo:400:kworker.0 Request processed in 31us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380295.310243:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1787380295.310267:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3dae680 x1874203867438848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380295.310276:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867438848:0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.310317:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380295.310324:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1874203867438976:0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.310347:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380295.310367:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867438976 00000100:00100000:0.0:1787380295.310370:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867438976 00000100:00100000:0.0:1787380295.310392:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787380295.310397:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874203867438976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.310427:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874203867438976:12345-0@lo:400:kworker.0 Request processed in 30us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380295.310433:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787380295.310458:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1874203867438976:0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.310496:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867439104:0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.310518:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380295.310540:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867439104 00000100:00100000:0.0:1787380295.310543:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867439104 00000100:00100000:0.0:1787380295.310564:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787380295.310571:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867439104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.310603:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867439104:12345-0@lo:400:kworker.0 Request processed in 32us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380295.310609:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00010000:00080000:0.0:1787380295.310633:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3dae680 x1874203867439104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380295.310642:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867439104:0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.310672:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380295.310679:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867439232:0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.310701:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380295.310723:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867439232 00000100:00100000:0.0:1787380295.310727:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867439232 00000100:00100000:0.0:1787380295.310751:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787380295.310757:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3daca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867439232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380295.310789:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3daca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867439232:12345-0@lo:400:kworker.0 Request processed in 32us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380295.310795:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1787380295.310840:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3dae680 x1874203867439232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380295.310850:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3dae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867439232:0@lo:400:kworker.0 00000100:00100000:3.0:1787380295.311698:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5dc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867439360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380295.311750:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380295.311839:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867439360 00000100:00100000:2.0:1787380295.311845:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867439360 00000100:00100000:2.0:1787380295.311875:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787380295.311882:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867439360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787380295.311904:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380295.311942:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867439360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380295.311949:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1787380295.312022:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5dc9880 x1874203867439360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380295.312036:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5dc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867439360:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787380295.312109:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787380295.312114:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787380295.312117:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787380295.312119:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787380295.312133:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867437952 00000100:00100000:1.0:1787380295.312137:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867437952 00000100:00100000:1.0:1787380295.312172:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1787380295.312179:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3642:x1874203867437952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380295.312223:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3642:x1874203867437952:12345-0@lo:400:kworker.0 Request processed in 45us (3243us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380295.312367:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867437952:0@lo:400:kworker.0 00000100:00100000:1.0:1787380295.312434:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1787380295.312471:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867438336 00000100:00100000:1.0:1787380295.312475:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867438336 00000100:00100000:1.0:1787380295.312506:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787380295.312513:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe6a82050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867438336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380295.312562:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe6a82050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867438336:12345-0@lo:400:kworker.0 Request processed in 49us (3178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380295.312569:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1787380295.312790:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5dca680 x1874203867437696/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380295.312805:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5dca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867437696:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787380295.312959:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867438336:0@lo:400:kworker.0 00010000:00010000:1.0:1787380295.758179:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380295.820661:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867439488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380295.820858:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380295.820920:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380295.820927:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867439616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380295.820951:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380295.822539:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867439488 00000100:00100000:2.0:1787380295.822553:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867439488 00000100:00100000:2.0:1787380295.822595:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867439616 00000100:00100000:2.0:1787380295.822598:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867439616 00000100:00100000:2.0:1787380295.822612:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787380295.822621:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867439488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787380295.822651:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380295.822724:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867439488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (1865us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380295.822731:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787380295.822747:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787380295.822753:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867439616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380295.822763:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380295.822787:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867439616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380295.822793:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1787380295.823001:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec361e680 x1874203867439616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380295.823020:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867439616:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787380295.823032:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5dcad80 x1874203867439488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380295.823042:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5dcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867439488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380295.839856:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380295.839887:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380295.839924:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380295.839954:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848489472 00000100:00100000:3.0:1787380295.839961:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380295.839965:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848489472 00000100:00100000:3.0:1787380295.839988:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848489600 00000100:00100000:3.0:1787380295.839994:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848489600 00000100:00100000:1.0:1787380295.840024:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848489728 00000100:00100000:1.0:1787380295.840029:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848489728 00000100:00100000:3.0:1787380295.840052:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 147 00000100:00100000:3.0:1787380295.840067:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2398:x1874203848489472:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380295.840142:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2398:x1874203848489472:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380295.840199:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848489344 00000100:00100000:0.0:1787380295.840204:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848489344 00000100:00100000:0.0:1787380295.840234:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 305 00000100:00100000:0.0:1787380295.840241:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2398:x1874203848489344:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380295.840263:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 148 00000100:00100000:0.0:1787380295.840270:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2398:x1874203848489344:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 28us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380295.840285:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848489600:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380295.840293:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 305 00000100:00100000:1.0:1787380295.840328:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848489600:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 57us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380295.840335:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 148 00000100:00100000:1.0:1787380295.840358:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 149 00000100:00100000:1.0:1787380295.840365:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848489728:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380295.840394:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848489728:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 29us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380295.840400:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 149 00000100:00080000:1.0:1787380295.840418:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787380295.840432:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380295.842071:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380295.842107:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380295.842124:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380295.842146:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848489984 00000100:00100000:0.0:1787380295.842152:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848489984 00000100:00100000:0.0:1787380295.842189:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848490112 00000100:00100000:0.0:1787380295.842193:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848490112 00000100:00100000:1.0:1787380295.842212:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 60 00000100:00100000:0.0:1787380295.842220:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 61 00000100:00100000:1.0:1787380295.842226:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3dae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848489984:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380295.842232:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3daf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848490112:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380295.842306:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3daf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848490112:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 78us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380295.842313:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 61 00000100:00100000:3.0:1787380295.844133:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 147 00000100:00100000:3.0:1787380295.844169:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848489856 00000100:00100000:3.0:1787380295.844177:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848489856 00000100:00100000:3.0:1787380295.845148:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 150 00000100:00100000:3.0:1787380295.845163:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848489856:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380295.846264:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3dae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848489984:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 4037us (4191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380295.846275:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 60 00000100:00080000:1.0:1787380295.846326:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787380295.846332:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787380295.846335:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380295.852611:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848489856:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 7440us (10489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380295.852627:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 150 00010000:00010000:0.0:1787380296.781373:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380296.844824:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380296.844846:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867439744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787380296.844907:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380296.844964:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867439744 00000100:00100000:2.0:1787380296.844971:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867439744 00000100:00100000:2.0:1787380296.845015:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787380296.845023:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867439744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787380296.845055:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787380296.845099:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867439744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380296.845106:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787380296.845149:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867439744:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787380297.804680:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787380298.816873:0:12505:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787380298.817568:0:12505:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787380298.838542:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380299.864386:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380300.434367:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867439872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380300.434430:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380300.434627:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867439872 00000100:00100000:2.0:1787380300.434634:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867439872 00000100:00100000:2.0:1787380300.434683:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787380300.434692:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867439872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787380300.434719:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380300.434761:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867439872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380300.434768:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787380300.434786:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787380300.434829:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5dcb480 x1874203867439872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380300.434846:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867439872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380300.437641:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3dac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867440000:0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.437701:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380300.437736:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3dadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867440512:0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.437761:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380300.437780:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867441024:0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.437835:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380300.437857:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787380300.437863:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3dadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867440128:0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.437886:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380300.437902:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3daf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867440640:0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.437921:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380300.437935:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867441152:0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.437953:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380300.437980:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867440000 00000100:00100000:0.0:1787380300.437986:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867440000 00000100:00100000:0.0:1787380300.439762:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1787380300.439782:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867440000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.439864:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867440000:12345-0@lo:400:kworker.0 Request processed in 92us (2163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380300.439871:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1787380300.439906:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867440512 00000100:00100000:0.0:1787380300.439912:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867440512 00000100:00100000:0.0:1787380300.439940:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787380300.439946:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867440512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.439978:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867440512:12345-0@lo:400:kworker.0 Request processed in 32us (2216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380300.439984:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787380300.440000:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867441024 00000100:00100000:0.0:1787380300.440014:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867441024 00000100:00100000:0.0:1787380300.440044:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787380300.440049:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867441024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.440088:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867441024:12345-0@lo:400:kworker.0 Request processed in 39us (2254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380300.440094:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787380300.440120:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867440128 00000100:00100000:0.0:1787380300.440124:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867440128 00000100:00100000:0.0:1787380300.440144:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867440640 00000100:00100000:0.0:1787380300.440146:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867440640 00000100:00100000:0.0:1787380300.440156:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867441152 00000100:00100000:0.0:1787380300.440158:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867441152 00000100:00100000:0.0:1787380300.440170:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787380300.440175:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867440128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.440202:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867440128:12345-0@lo:400:kworker.0 Request processed in 28us (2316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380300.440208:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787380300.440219:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787380300.440224:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867440640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.440245:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867440640:12345-0@lo:400:kworker.0 Request processed in 22us (2323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380300.440250:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787380300.440270:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787380300.440275:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867441152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.440297:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867441152:12345-0@lo:400:kworker.0 Request processed in 22us (2343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380300.440302:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787380300.440341:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3dadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867440128:0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.440362:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3daf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867440640:0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.440379:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867441152:0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.440387:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3dac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867440000:0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.440395:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3dadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867440512:0@lo:400:kworker.0 00010000:00080000:0.0:1787380300.440407:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff4f20e00 x1874203867441024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380300.440416:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867441024:0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.440478:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3dafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867440256:0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.442345:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380300.442383:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3dace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867440768:0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.442409:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380300.442426:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867441280:0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.442443:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380300.443339:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787380300.443405:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3dad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867440384:0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.443440:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380300.443509:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3dac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867440896:0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.443533:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380300.443549:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867441408:0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.443567:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380300.443602:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867440256 00000100:00100000:0.0:1787380300.443609:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867440256 00000100:00100000:0.0:1787380300.443648:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787380300.443656:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867440256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.443718:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867440256:12345-0@lo:400:kworker.0 Request processed in 61us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380300.443725:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787380300.443748:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867440768 00000100:00100000:0.0:1787380300.443751:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867440768 00000100:00100000:0.0:1787380300.443775:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867441280 00000100:00100000:0.0:1787380300.443778:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867441280 00000100:00100000:0.0:1787380300.443789:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867440384 00000100:00100000:0.0:1787380300.443791:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867440384 00000100:00100000:0.0:1787380300.443801:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787380300.443821:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867440768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.443852:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867440768:12345-0@lo:400:kworker.0 Request processed in 45us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380300.443858:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787380300.443870:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787380300.443875:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867441280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.443901:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867441280:12345-0@lo:400:kworker.0 Request processed in 26us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380300.443907:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787380300.443917:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787380300.443922:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867440384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.443945:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867440384:12345-0@lo:400:kworker.0 Request processed in 23us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380300.443950:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787380300.443970:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867440896 00000100:00100000:0.0:1787380300.443973:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867440896 00000100:00100000:0.0:1787380300.443996:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867441408 00000100:00100000:0.0:1787380300.444434:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867441408 00000100:00100000:0.0:1787380300.444472:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787380300.444479:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867440896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.444511:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867440896:12345-0@lo:400:kworker.0 Request processed in 34us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380300.444518:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787380300.444529:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787380300.444535:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867441408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.444561:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867441408:12345-0@lo:400:kworker.0 Request processed in 27us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380300.444567:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787380300.444615:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3dad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867440384:0@lo:400:kworker.0 00010000:00080000:0.0:1787380300.444627:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3dac700 x1874203867440896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380300.444637:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3dac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867440896:0@lo:400:kworker.0 00010000:00080000:0.0:1787380300.444646:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff4f22d80 x1874203867441408/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380300.444654:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867441408:0@lo:400:kworker.0 00000100:00100000:0.0:1787380300.444663:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3dafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867440256:0@lo:400:kworker.0 00010000:00080000:0.0:1787380300.444673:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3dace00 x1874203867440768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380300.444680:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3dace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867440768:0@lo:400:kworker.0 00010000:00080000:0.0:1787380300.444689:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff4f22a00 x1874203867441280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380300.444704:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867441280:0@lo:400:kworker.0 00000100:00080000:0.0:1787380300.444736:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380300.444740:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787380300.444743:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787380300.444745:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380300.452348:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867441536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380300.452421:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380300.452473:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867441536 00000100:00100000:0.0:1787380300.452480:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867441536 00000100:00100000:0.0:1787380300.452522:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787380300.452531:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867441536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787380300.452562:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787380300.452603:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867441536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380300.452610:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787380300.452653:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867441536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380300.453915:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867441664:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380300.453961:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380300.455731:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867441664 00000100:00100000:2.0:1787380300.455757:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867441664 00000100:00100000:2.0:1787380300.455838:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787380300.457102:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867441664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787380300.457128:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380300.457203:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867441664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (3241us total) trans 0 rc 0/0 00010000:00080000:0.0:1787380300.457269:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff4f22a00 x1874203867441664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380300.457289:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867441664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380300.473105:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:2.0:1787380300.880908:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380300.940413:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867441792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380300.940484:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380300.940602:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867441792 00000100:00100000:1.0:1787380300.940610:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867441792 00000100:00100000:1.0:1787380300.940659:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787380300.940669:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867441792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787380300.940693:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380300.940737:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed05050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867441792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380300.940744:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1787380300.941120:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec361f100 x1874203867441792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380300.941153:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867441792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380300.942650:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867441920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380300.942703:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380300.942784:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867441920 00000100:00100000:2.0:1787380300.942790:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867441920 00000100:00100000:2.0:1787380300.942858:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787380300.942867:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867441920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787380300.942885:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380300.943408:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867441920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 541us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380300.943416:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1787380300.943480:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3cb2d80 x1874203867441920/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380300.943498:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867441920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380300.957421:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380300.957461:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380300.957544:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380300.957583:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848490240 00000100:00100000:3.0:1787380300.957592:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848490240 00000100:00100000:0.0:1787380300.957604:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380300.957622:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380300.957644:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848490496 00000100:00100000:3.0:1787380300.957647:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 307 00000100:00100000:2.0:1787380300.957649:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848490496 00000100:00100000:3.0:1787380300.957656:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2397:x1874203848490240:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380300.957682:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848490752 00000100:00100000:2.0:1787380300.957685:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848490752 00000100:00100000:2.0:1787380300.957702:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 157 00000100:00100000:2.0:1787380300.957708:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2397:x1874203848490496:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380300.957714:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2397:x1874203848490240:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 59us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380300.957720:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 307 00000100:00100000:2.0:1787380300.957749:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2397:x1874203848490496:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 29us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380300.957756:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 157 00000100:00100000:2.0:1787380300.957769:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 158 00000100:00100000:2.0:1787380300.957775:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848490752:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380300.957834:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848490752:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 58us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380300.957850:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 158 00000100:00100000:0.0:1787380300.958500:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380300.958566:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380300.958650:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848491008 00000100:00100000:3.0:1787380300.958655:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848491008 00000100:00100000:3.0:1787380300.958689:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848490880 00000100:00100000:3.0:1787380300.958692:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848490880 00000100:00100000:3.0:1787380300.958714:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 65 00000100:00100000:3.0:1787380300.958720:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848491008:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380300.958782:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848490368 00000100:00100000:2.0:1787380300.958787:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848490368 00000100:00100000:3.0:1787380300.958822:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848491008:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 88us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380300.958824:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848490624 00000100:00100000:2.0:1787380300.958827:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848490624 00000100:00100000:3.0:1787380300.958838:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 65 00000100:00100000:2.0:1787380300.958852:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 159 00000100:00100000:3.0:1787380300.958853:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00100000:2.0:1787380300.958859:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2397:x1874203848490368:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380300.958868:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3dace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848490880:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380300.958887:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3dace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848490880:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 28us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380300.958887:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2397:x1874203848490368:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 28us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380300.958894:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00100000:2.0:1787380300.958894:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 159 00000100:00100000:2.0:1787380300.958905:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 160 00000100:00100000:2.0:1787380300.958922:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848490624:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380300.958947:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848490624:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 36us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380300.958953:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 160 00000100:00080000:0.0:1787380300.959443:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787380300.959449:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787380300.959451:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380300.959453:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000004:1.0:1787380301.171687:0:12602:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787380301.172101:0:12602:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787380301.901257:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380301.964073:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867442048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787380301.964144:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380301.964218:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867442048 00000100:00100000:1.0:1787380301.964227:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867442048 00000100:00100000:1.0:1787380301.964298:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787380301.964307:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867442048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380301.964336:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380301.967328:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867442048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3014us (3176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380301.967343:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787380301.967356:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5dcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867442048:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787380302.924060:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787380303.173763:0:12699:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787380303.174404:0:12699:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787380303.953244:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380304.974915:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380305.551595:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867442176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380305.551646:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5dcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867442304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380305.551662:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380305.551684:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867442176 00000100:00100000:2.0:1787380305.551691:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867442176 00000100:00100000:2.0:1787380305.551741:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787380305.551749:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867442176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787380305.551786:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380305.551851:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867442176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380305.551862:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1787380305.551881:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787380305.551894:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787380305.551937:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5dca300 x1874203867442176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380305.551952:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5dca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867442176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380305.551975:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867442304 00000100:00100000:2.0:1787380305.551978:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867442304 00000100:00100000:2.0:1787380305.552015:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787380305.552022:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867442304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787380305.552042:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380305.552071:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867442304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380305.552077:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1787380305.552116:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5dcb100 x1874203867442304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380305.552127:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5dcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867442304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380305.552447:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867442432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380305.552475:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380305.552502:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867442944:0@lo:400:kworker.0 00000100:00100000:2.0:1787380305.552534:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380305.552564:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867443456:0@lo:400:kworker.0 00000100:00100000:2.0:1787380305.552587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380305.552607:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787380305.552613:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867442816:0@lo:400:kworker.0 00000100:00100000:2.0:1787380305.552631:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380305.552645:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867443328:0@lo:400:kworker.0 00000100:00100000:2.0:1787380305.552662:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380305.552677:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1874203867443840:0@lo:400:kworker.0 00000100:00100000:2.0:1787380305.552695:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380305.552718:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867442944 00000100:00100000:2.0:1787380305.552723:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867442944 00000100:00100000:2.0:1787380305.552750:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867443328 00000100:00100000:2.0:1787380305.552754:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867443328 00000100:00100000:2.0:1787380305.552767:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867443840 00000100:00100000:2.0:1787380305.552769:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867443840 00000100:00100000:2.0:1787380305.552780:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787380305.552786:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867442944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380305.552847:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867442944:12345-0@lo:400:kworker.0 Request processed in 60us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380305.552853:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787380305.552866:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787380305.552872:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867443328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380305.552899:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867443328:12345-0@lo:400:kworker.0 Request processed in 27us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380305.552904:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787380305.552914:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787380305.552920:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874203867443840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380305.552952:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874203867443840:12345-0@lo:400:kworker.0 Request processed in 33us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380305.552958:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787380305.552975:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867443456 00000100:00100000:2.0:1787380305.552978:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867443456 00000100:00100000:2.0:1787380305.553002:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787380305.553008:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867443456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380305.553242:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867442432 00000100:00100000:3.0:1787380305.553248:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867442432 00000100:00100000:3.0:1787380305.553270:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867442816 00000100:00100000:3.0:1787380305.553272:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867442816 00000100:00100000:3.0:1787380305.553283:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787380305.553288:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1874203867442432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787380305.553312:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787380305.553344:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1874203867442432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380305.553350:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787380305.553371:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787380305.553377:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867442816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380305.553446:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867442816:12345-0@lo:400:kworker.0 Request processed in 69us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380305.553452:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1787380305.553590:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787380305.553595:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787380305.553604:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787380305.553617:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867442560:0@lo:400:kworker.0 00000100:00100000:1.0:1787380305.553650:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380305.553689:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867443072:0@lo:400:kworker.0 00000100:00100000:1.0:1787380305.553710:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380305.553746:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867443584:0@lo:400:kworker.0 00000100:00100000:1.0:1787380305.553769:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380305.553805:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787380305.553838:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867442560 00000100:00100000:0.0:1787380305.553843:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867442560 00000100:00100000:1.0:1787380305.553863:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867442688:0@lo:400:kworker.0 00000100:00100000:0.0:1787380305.553875:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1787380305.553880:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867442560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380305.553900:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380305.553911:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867442560:12345-0@lo:400:kworker.0 Request processed in 31us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380305.553917:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867443200:0@lo:400:kworker.0 00000100:00100000:0.0:1787380305.553917:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1787380305.553969:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380305.553997:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867443712:0@lo:400:kworker.0 00000100:00100000:1.0:1787380305.554235:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380305.554259:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867442560:0@lo:400:kworker.0 00000100:00100000:1.0:1787380305.554284:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867443584 00000100:00100000:1.0:1787380305.554287:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867443584 00000100:00100000:1.0:1787380305.554331:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787380305.554338:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867443584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380305.554372:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867443584:12345-0@lo:400:kworker.0 Request processed in 34us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380305.554378:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787380305.554414:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867442688 00000100:00100000:1.0:1787380305.554418:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867442688 00000100:00100000:1.0:1787380305.554445:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867443200 00000100:00100000:1.0:1787380305.554449:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867443200 00000100:00100000:1.0:1787380305.554492:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867443712 00000100:00100000:1.0:1787380305.554496:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867443712 00000100:00080000:0.0:1787380305.554564:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787380305.554568:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380305.554645:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867443456:12345-0@lo:400:kworker.0 Request processed in 1636us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380305.554652:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787380305.554674:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787380305.554680:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867442688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380305.554709:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867442688:12345-0@lo:400:kworker.0 Request processed in 29us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380305.554734:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787380305.554757:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787380305.554764:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867443200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380305.554821:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867443200:12345-0@lo:400:kworker.0 Request processed in 44us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380305.554828:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787380305.554882:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867442688:0@lo:400:kworker.0 00000100:00100000:2.0:1787380305.554888:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867442816:0@lo:400:kworker.0 00000100:00100000:0.0:1787380305.554892:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867443200:0@lo:400:kworker.0 00010000:00080000:0.0:1787380305.554902:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3cb1c00 x1874203867443584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380305.554912:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867443584:0@lo:400:kworker.0 00000100:00100000:3.0:1787380305.555324:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867443072 00000100:00100000:3.0:1787380305.555341:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867443072 00000100:00100000:3.0:1787380305.555407:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787380305.555438:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867443072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380305.555536:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867443072:12345-0@lo:400:kworker.0 Request processed in 113us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380305.555542:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787380305.555573:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867443072:0@lo:400:kworker.0 00000100:00100000:1.0:1787380305.555919:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787380305.555931:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867443712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380305.555978:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867443712:12345-0@lo:400:kworker.0 Request processed in 51us (1753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380305.556052:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867443712:0@lo:400:kworker.0 00010000:00080000:2.0:1787380305.556267:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3cb3b80 x1874203867443328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380305.556279:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867443328:0@lo:400:kworker.0 00010000:00080000:2.0:1787380305.556306:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3cb2d80 x1874203867443840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380305.556315:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1874203867443840:0@lo:400:kworker.0 00000100:00100000:2.0:1787380305.556332:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867442432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380305.556344:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867442944:0@lo:400:kworker.0 00010000:00080000:2.0:1787380305.556355:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3cb1180 x1874203867443456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380305.556364:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867443456:0@lo:400:kworker.0 00000100:00100000:1.0:1787380305.560243:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000020:00000004:2.0:1787380305.773705:0:12797:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787380305.775005:0:12797:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787380305.996015:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380306.060206:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867443968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380306.060279:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380306.060392:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867443968 00000100:00100000:1.0:1787380306.060400:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867443968 00000100:00100000:1.0:1787380306.060452:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787380306.060461:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867443968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787380306.060490:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380306.060537:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867443968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380306.060555:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1787380306.060593:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec361c380 x1874203867443968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380306.060610:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867443968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380306.061825:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380306.061839:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5dc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867444096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380306.061891:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380306.061973:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867444096 00000100:00100000:1.0:1787380306.061979:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867444096 00000100:00100000:1.0:1787380306.062015:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787380306.062023:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867444096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787380306.062038:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380306.062079:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867444096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380306.062085:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1787380306.062190:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5dc8e00 x1874203867444096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380306.062204:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5dc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867444096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380306.086359:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380306.086442:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380306.086469:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380306.086491:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380306.086508:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380306.086539:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380306.086558:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380306.086583:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848491392 00000100:00100000:0.0:1787380306.086590:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848491392 00000100:00100000:0.0:1787380306.086630:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848491648 00000100:00100000:0.0:1787380306.086633:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848491648 00000100:00100000:0.0:1787380306.086656:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848491264 00000100:00100000:0.0:1787380306.086659:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848491264 00000100:00100000:3.0:1787380306.086668:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848491520 00000100:00100000:3.0:1787380306.086675:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848491520 00000100:00100000:0.0:1787380306.086677:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 167 00000100:00100000:0.0:1787380306.086689:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848491392:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380306.086712:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 168 00000100:00100000:3.0:1787380306.086723:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848491648:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380306.086765:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848491648:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 42us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380306.086766:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848491392:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 67us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380306.086781:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 168 00000100:00100000:2.0:1787380306.089770:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848491136 00000100:00100000:2.0:1787380306.089785:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848491136 00000100:00100000:2.0:1787380306.090169:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 309 00000100:00100000:2.0:1787380306.090179:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2398:x1874203848491136:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380306.090273:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2398:x1874203848491136:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 96us (3923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380306.090282:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 309 00000100:00080000:2.0:1787380306.091189:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380306.091196:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787380306.091236:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848491776 00000100:00100000:2.0:1787380306.091245:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848491776 00000100:00100000:2.0:1787380306.091310:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848491904 00000100:00100000:2.0:1787380306.091313:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848491904 00000100:00100000:2.0:1787380306.091336:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00100000:2.0:1787380306.091343:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2396:x1874203848491776:12345-192.168.206.30@tcp:9:kworker.0 00000020:00000080:2.0:1787380306.091365:0:12152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68e00 00000100:00080000:2.0:1787380306.091373:0:12152:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2626000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787380306.091409:0:12152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787380306.091564:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd549a2a-de1a-4b9c-be02-339b2f6be909+2:2396:x1874203848491776:12345-192.168.206.30@tcp:9:kworker.0 Request processed in 220us (5023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380306.091572:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00100000:2.0:1787380306.091586:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:2.0:1787380306.091593:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2396:x1874203848491904:12345-192.168.206.30@tcp:9:kworker.0 00000020:00000080:2.0:1787380306.091605:0:12152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68e07 00000100:00080000:2.0:1787380306.091611:0:12152:0:(import.c:65:import_set_state_nolock()) ffff9d6ff4ffa800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787380306.091631:0:12152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1787380306.091707:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bd549a2a-de1a-4b9c-be02-339b2f6be909+2:2396:x1874203848491904:12345-192.168.206.30@tcp:9:kworker.0 Request processed in 114us (5147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380306.091715:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 23 00010000:00010000:2.0:1787380306.091736:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787380306.091743:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787380306.091746:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380306.093130:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 167 00000100:00100000:3.0:1787380306.093158:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 169 00000100:00100000:1.0:1787380306.093294:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 170 00010000:00010000:1.0:1787380306.093328:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380306.093341:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848491520:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380306.093397:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848491520:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 92us (6888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380306.095247:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2398:x1874203848491264:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380306.095304:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2398:x1874203848491264:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 88us (8812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380306.095312:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 169 00000100:00100000:1.0:1787380306.097081:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 170 00010000:00010000:0.0:1787380307.020055:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380307.084043:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380307.084063:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867444224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787380307.084127:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380307.084191:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867444224 00000100:00100000:0.0:1787380307.084198:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867444224 00000100:00100000:0.0:1787380307.084261:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787380307.084270:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867444224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787380307.084299:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787380307.084340:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867444224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380307.084347:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787380307.084388:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867444224:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1787380307.915056:0:12894:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787380307.915289:0:12894:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787380308.055386:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380309.071619:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380310.093217:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380310.668040:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867444352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380310.668107:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380310.668372:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5dc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867444480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787380310.668401:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380310.668448:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380310.668454:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867444864:0@lo:400:kworker.0 00000100:00100000:1.0:1787380310.668474:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380310.668501:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867444480 00000100:00100000:1.0:1787380310.668509:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867444480 00000100:00100000:1.0:1787380310.668559:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787380310.668568:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867444480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787380310.668596:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380310.668639:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867444480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380310.668646:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787380310.668667:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867444864 00000100:00100000:1.0:1787380310.668671:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867444864 00000100:00100000:1.0:1787380310.668697:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787380310.668702:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867444864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380310.668732:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867444864:12345-0@lo:400:kworker.0 Request processed in 29us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380310.668753:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1787380310.668952:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867444864:0@lo:400:kworker.0 00010000:00080000:1.0:1787380310.668967:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5dc8700 x1874203867444480/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380310.668982:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5dc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867444480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787380310.669031:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867444608:0@lo:400:kworker.0 00000100:00100000:1.0:1787380310.669060:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380310.669084:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787380310.669091:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867444736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787380310.669112:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380310.669131:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867444736 00000100:00100000:1.0:1787380310.669134:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867444736 00000100:00100000:1.0:1787380310.669155:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787380310.669160:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867444736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380310.669171:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380310.669211:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867444736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380310.669217:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:1.0:1787380310.669243:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec361c380 x1874203867444736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380310.669255:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867444736:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787380310.669479:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787380310.669497:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867444608 00000100:00100000:1.0:1787380310.669501:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867444608 00000100:00100000:1.0:1787380310.669534:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1787380310.669540:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867444608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380310.669572:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867444608:12345-0@lo:400:kworker.0 Request processed in 32us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380310.669579:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1787380310.669609:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867444608:0@lo:400:kworker.0 00000100:00100000:1.0:1787380310.670558:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867444352 00000100:00100000:1.0:1787380310.670567:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867444352 00000100:00100000:1.0:1787380310.670599:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787380310.670607:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867444352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787380310.670635:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787380310.670906:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867444992:0@lo:400:kworker.0 00000100:00100000:0.0:1787380310.670965:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1874203867445248:0@lo:400:kworker.0 00000100:00100000:0.0:1787380310.671001:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867445120:0@lo:400:kworker.0 00000100:00100000:0.0:1787380310.671024:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380310.671043:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867445632:0@lo:400:kworker.0 00000100:00100000:0.0:1787380310.671063:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380310.671091:0:6526:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1787380310.671099:0:6526:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1787380310.671180:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867445120 00000100:00100000:0.0:1787380310.671184:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867445120 00000100:00100000:0.0:1787380310.671301:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787380310.671308:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867445120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380310.671628:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867445120:12345-0@lo:400:kworker.0 Request processed in 319us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380310.671636:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787380310.671667:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867445120:0@lo:400:kworker.0 00000100:00100000:0.0:1787380310.671706:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867445632 00000100:00100000:0.0:1787380310.671710:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867445632 00000100:00100000:0.0:1787380310.671742:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787380310.671748:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867445632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380310.671782:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867445632:12345-0@lo:400:kworker.0 Request processed in 34us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380310.671787:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1787380310.671837:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34efb80 x1874203867445632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380310.671848:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867445632:0@lo:400:kworker.0 00000100:00080000:0.0:1787380310.671870:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380310.672018:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867445376:0@lo:400:kworker.0 00000100:00100000:2.0:1787380310.672321:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380310.673177:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867445504:0@lo:400:kworker.0 00000100:00100000:2.0:1787380310.673232:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380310.673291:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380310.674790:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867444352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4178us (6677us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380310.674804:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787380310.674879:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867445504 00000100:00100000:1.0:1787380310.674887:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867445504 00000100:00100000:1.0:1787380310.674938:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787380310.674946:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867445504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380310.675008:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867445504:12345-0@lo:400:kworker.0 Request processed in 62us (1778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380310.675014:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1787380310.675033:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787380310.675150:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34ed180 x1874203867445504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380310.675165:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867445504:0@lo:400:kworker.0 00000100:00100000:2.0:1787380310.675444:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1874203867445760:0@lo:400:kworker.0 00000100:00100000:2.0:1787380310.675679:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380310.675698:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867444992 00000100:00100000:3.0:1787380310.675703:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867444992 00000100:00100000:1.0:1787380310.675712:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867445248 00000100:00100000:1.0:1787380310.675718:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867445248 00000100:00100000:3.0:1787380310.675753:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787380310.675935:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787380310.675940:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867444992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380310.675949:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874203867445248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380310.676223:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874203867445248:12345-0@lo:400:kworker.0 Request processed in 278us (2934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380310.676232:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867444992:12345-0@lo:400:kworker.0 Request processed in 295us (3909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380310.676233:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787380310.676245:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:1.0:1787380310.676272:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380310.676299:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867444992:0@lo:400:kworker.0 00000100:00100000:2.0:1787380310.676691:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1874203867445248:0@lo:400:kworker.0 00000100:00100000:3.0:1787380310.676762:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380310.676795:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867445888:0@lo:400:kworker.0 00000100:00100000:3.0:1787380310.676843:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380310.676878:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867444352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380310.676912:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867445760 00000100:00100000:3.0:1787380310.676918:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867445760 00000100:00100000:3.0:1787380310.676945:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867445376 00000100:00100000:3.0:1787380310.677123:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867445376 00000100:00100000:3.0:1787380310.677143:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867445888 00000100:00100000:3.0:1787380310.677146:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867445888 00000100:00100000:3.0:1787380310.677162:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787380310.677169:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874203867445760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380310.677219:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874203867445760:12345-0@lo:400:kworker.0 Request processed in 50us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380310.677225:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787380310.677241:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787380310.677247:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867445376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380310.677275:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867445376:12345-0@lo:400:kworker.0 Request processed in 29us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380310.677281:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1787380310.677291:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787380310.677306:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867445888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380310.677330:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867445888:12345-0@lo:400:kworker.0 Request processed in 25us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380310.677335:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00010000:00080000:3.0:1787380310.677363:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34eca80 x1874203867445376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380310.677374:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867445376:0@lo:400:kworker.0 00010000:00080000:3.0:1787380310.677582:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5d9b480 x1874203867445888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380310.677655:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867445888:0@lo:400:kworker.0 00000100:00100000:2.0:1787380310.677749:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1874203867445760:0@lo:400:kworker.0 00000100:00080000:1.0:1787380310.677847:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787380310.677852:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787380311.119391:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380311.181248:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867446016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380311.181317:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380311.181445:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867446016 00000100:00100000:1.0:1787380311.181453:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867446016 00000100:00100000:1.0:1787380311.181505:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787380311.181514:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867446016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787380311.181544:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380311.181589:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867446016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380311.181596:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:0.0:1787380311.181960:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc43e9f80 x1874203867446016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380311.181980:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867446016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380311.182238:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380311.182250:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5dc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867446144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380311.182286:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380311.182364:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867446144 00000100:00100000:1.0:1787380311.182369:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867446144 00000100:00100000:1.0:1787380311.182400:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787380311.182407:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867446144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787380311.182420:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380311.182461:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867446144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380311.182467:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1787380311.182656:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5dc8a80 x1874203867446144/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380311.182669:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5dc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867446144:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380311.207603:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380311.207639:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380311.207662:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380311.207677:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380311.207702:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380311.207728:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848492160 00000100:00100000:0.0:1787380311.207737:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848492160 00000100:00100000:0.0:1787380311.207783:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848492416 00000100:00100000:0.0:1787380311.207786:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848492416 00000100:00100000:0.0:1787380311.207799:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848492288 00000100:00100000:0.0:1787380311.207802:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848492288 00000100:00100000:0.0:1787380311.207832:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848492544 00000100:00100000:0.0:1787380311.207835:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848492544 00000100:00100000:0.0:1787380311.207852:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 177 00000100:00100000:0.0:1787380311.207861:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2400:x1874203848492160:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380311.207941:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2400:x1874203848492160:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 81us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380311.207950:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 177 00000100:00100000:0.0:1787380311.207966:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 178 00000100:00100000:0.0:1787380311.207973:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848492416:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380311.208010:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848492416:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 38us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380311.208017:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 178 00000100:00100000:0.0:1787380311.208028:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 179 00000100:00100000:0.0:1787380311.208033:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848492288:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380311.208054:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848492288:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 21us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380311.208060:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 179 00000100:00100000:0.0:1787380311.208071:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 180 00000100:00100000:0.0:1787380311.208077:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848492544:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380311.208099:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848492544:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 23us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380311.208105:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 180 00000100:00100000:0.0:1787380311.208122:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848492032 00000100:00100000:0.0:1787380311.208125:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848492032 00000100:00100000:0.0:1787380311.208151:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 311 00000100:00100000:0.0:1787380311.208158:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2400:x1874203848492032:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380311.208184:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2400:x1874203848492032:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 27us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380311.208190:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 311 00000100:00080000:0.0:1787380311.208230:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787380311.208234:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1787380311.694430:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bd549a2a-de1a-4b9c-be02-339b2f6be909 00000020:00000080:0.0:1787380311.694439:0:9514:0:(genops.c:906:class_export_put()) final put ffff9d6ff4ff8000/bd549a2a-de1a-4b9c-be02-339b2f6be909 00000020:00000080:3.0:1787380311.695655:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff4ff8000/bd549a2a-de1a-4b9c-be02-339b2f6be909 for lustre-OST0001 00000020:00000080:3.0:1787380311.695709:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ff4ffa800 for lustre-OST0001 00000001:00100000:3.0:1787380311.696837:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bd549a2a-de1a-4b9c-be02-339b2f6be909 00000020:00000080:3.0:1787380311.696843:0:8429:0:(genops.c:906:class_export_put()) final put ffff9d6ec2626800/bd549a2a-de1a-4b9c-be02-339b2f6be909 00000020:00000080:2.0:1787380311.697349:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec2626800/bd549a2a-de1a-4b9c-be02-339b2f6be909 for lustre-OST0000 00000020:00000080:2.0:1787380311.697392:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec2626000 for lustre-OST0000 00000001:02000400:3.0:1787380311.784675:0:13040:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787380312.140054:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380312.205935:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867446272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787380312.206028:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380312.206955:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867446272 00000100:00100000:1.0:1787380312.206966:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867446272 00000100:00100000:1.0:1787380312.207029:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787380312.207038:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867446272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380312.207084:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380312.216141:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867446272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9095us (10104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380312.216156:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787380312.216503:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867446272:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787380313.166422:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380314.189672:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787380314.844717:0:13187:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fffce0489a0 00000020:00000080:2.0:1787380314.844732:0:13187:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787380314.844737:0:13187:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787380314.844744:0:13187:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffce04ac30 20000000:00000080:2.0:1787380314.844750:0:13187:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d6ec3d08c00 uarg=0000000000000000 20000000:01000000:2.0:1787380314.844792:0:13187:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787380314.844797:0:13187:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787380314.844801:0:13187:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787380314.845382:0:13188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1787380314.845602:0:13187:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787380314.852120:0:13187:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787380314.852150:0:13187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad68e0e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380314.852189:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68d9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab5a expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380314.852198:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe7867c00/0xcf3c46fdcad68dac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68da5 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380314.852204:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ff5d46200/0xcf3c46fdcad68dba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68db3 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380314.852210:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ff5d47a00/0xcf3c46fdcad68dc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68dc1 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380314.852216:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68dd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68dcf expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380314.852223:0:13187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad68deb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab99 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380314.852230:0:13187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad68e0e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380314.852269:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad68deb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab99 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380314.852283:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad68deb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab99 expref: 12 pid: 6516 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380314.852298:0:13187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5dcad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1874203867446400:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380314.853049:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68dd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68dcf expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380314.853068:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68dd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68dcf expref: 23 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380314.853080:0:13187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5dca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1874203867446528:0@lo:104: 00000100:00100000:2.0:1787380314.853122:0:13187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380314.854450:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867446528 00000100:00100000:1.0:1787380314.854460:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867446528 00000100:00100000:1.0:1787380314.854516:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787380314.854526:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:13187:x1874203867446528:12345-0@lo:104: 00010000:00010000:1.0:1787380314.854541:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46600/0xcf3c46fdcad68dcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68dd6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380314.854605:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787380314.854612:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:13187:x1874203867446528:12345-0@lo:104: Request processed in 88us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380314.854619:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1787380314.854639:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380314.854645:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46600/0xcf3c46fdcad68dcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68dd6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380314.854652:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46600 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:1.0:1787380314.854656:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46600/0xcf3c46fdcad68dcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68dd6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380314.854664:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46600/0xcf3c46fdcad68dcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68dd6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380314.854671:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46600/0xcf3c46fdcad68dcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68dd6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380314.854687:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787380314.854717:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46600/0xcf3c46fdcad68dcf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68dd6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380314.854723:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380314.854743:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46600/0xcf3c46fdcad68dcf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68dd6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380314.854750:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46600/0xcf3c46fdcad68dcf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68dd6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380314.854762:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380314.854763:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380314.854765:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380314.854778:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867446656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380314.854837:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380314.855579:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ff5d47a00/0xcf3c46fdcad68dc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68dc1 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380314.855592:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6ff5d47a00/0xcf3c46fdcad68dc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68dc1 expref: 23 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380314.855603:0:13187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1874203867446784:0@lo:104: 00000100:00100000:2.0:1787380314.855635:0:13187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380314.855669:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ff5d46200/0xcf3c46fdcad68dba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68db3 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380314.855676:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6ff5d46200/0xcf3c46fdcad68dba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68db3 expref: 23 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380314.855684:0:13187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1874203867446912:0@lo:104: 00000100:00100000:2.0:1787380314.855703:0:13187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380314.855772:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe7867c00/0xcf3c46fdcad68dac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68da5 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380314.855779:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fe7867c00/0xcf3c46fdcad68dac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68da5 expref: 23 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380314.855787:0:13187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1874203867447040:0@lo:104: 00000100:00100000:2.0:1787380314.855843:0:13187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380314.856133:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867446656 00000100:00100000:1.0:1787380314.856139:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867446656 00010000:00010000:1.0:1787380314.856162:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68dd6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68dcf expref: 24 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380314.856198:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787380314.856206:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867446656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380314.856216:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380314.856221:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68dd6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68dcf expref: 24 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380314.856231:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68dd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68dcf expref: 24 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380314.856255:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380314.856289:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867446656:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380314.856296:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787380314.856333:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867446656:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787380314.856439:0:13187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68d9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab5a expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380314.856449:0:13187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68d9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab5a expref: 12 pid: 6516 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380314.856459:0:13187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1874203867447168:192.168.206.30@tcp:104: 00000100:00100000:2.0:1787380314.856501:0:13187:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3f30c00 going to sleep for 11 seconds 00010000:00010000:2.0:1787380314.856514:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5d47800/0xcf3c46fdcad68dd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68dcf expref: 23 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380314.856525:0:13187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5dca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1874203867446528:0@lo:104: 00000100:00100000:3.0:1787380314.856659:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867446784 00000100:00100000:3.0:1787380314.856664:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867446784 00000100:00100000:3.0:1787380314.856686:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867446912 00000100:00100000:3.0:1787380314.856689:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867446912 00000100:00100000:3.0:1787380314.856698:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867447040 00000100:00100000:3.0:1787380314.856700:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867447040 00000100:00100000:3.0:1787380314.856725:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787380314.856730:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:13187:x1874203867446784:12345-0@lo:104: 00010000:00010000:3.0:1787380314.856740:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68dc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68dc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.856788:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787380314.856794:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:13187:x1874203867446784:12345-0@lo:104: Request processed in 64us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380314.856799:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787380314.856848:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787380314.856854:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:13187:x1874203867446912:12345-0@lo:104: 00010000:00010000:3.0:1787380314.856861:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68db3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68dba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.856890:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787380314.856895:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:13187:x1874203867446912:12345-0@lo:104: Request processed in 42us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380314.856900:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787380314.856912:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787380314.856917:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:13187:x1874203867447040:12345-0@lo:104: 00010000:00010000:3.0:1787380314.856923:0:8450:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ae00/0xcf3c46fdcad68da5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.856959:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787380314.856963:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:13187:x1874203867447040:12345-0@lo:104: Request processed in 46us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380314.856968:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1787380314.856983:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787380314.856992:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68dc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68dc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.856999:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47c00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380314.857002:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68dc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68dc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.857010:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68dc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68dc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380314.857016:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68dc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68dc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380314.857020:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787380314.857054:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68dc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68dc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.857061:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380314.857075:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68dc1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68dc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.857082:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68dc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68dc8 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.857092:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787380314.857095:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68db3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68dba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.857101:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165b000 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380314.857104:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68db3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68dba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.857119:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68dba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380314.857124:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68dba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380314.857129:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787380314.857141:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68db3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68dba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.857147:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380314.857161:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68db3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68dba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.857168:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68db3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68dba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.857186:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380314.857189:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ae00/0xcf3c46fdcad68da5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.857194:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165ae00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380314.857197:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ae00/0xcf3c46fdcad68da5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.857202:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ae00/0xcf3c46fdcad68da5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380314.857209:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ae00/0xcf3c46fdcad68da5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380314.857219:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787380314.857231:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ae00/0xcf3c46fdcad68da5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.857236:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380314.857242:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ae00/0xcf3c46fdcad68da5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.857249:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fc165ae00/0xcf3c46fdcad68da5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68dac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.857262:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380314.857263:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380314.857265:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380314.857276:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867447424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380314.857304:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380314.857326:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380314.857331:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867447552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380314.857350:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380314.857375:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867447424 00000100:00100000:3.0:1787380314.857379:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867447424 00010000:00010000:3.0:1787380314.857395:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ff5d46200/0xcf3c46fdcad68dba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68db3 expref: 23 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380314.857908:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867447552 00000100:00100000:3.0:1787380314.857912:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867447552 00010000:00010000:3.0:1787380314.857987:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe7867c00/0xcf3c46fdcad68dac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68da5 expref: 24 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380314.858019:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787380314.858086:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867447424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787380314.858098:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380314.858104:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ff5d46200/0xcf3c46fdcad68dba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68db3 expref: 24 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.858112:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ff5d46200/0xcf3c46fdcad68dba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68db3 expref: 24 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.858127:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380314.858165:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867447424:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380314.858182:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787380314.858204:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787380314.858210:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:3641:x1874203867447552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787380314.858219:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380314.858223:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe7867c00/0xcf3c46fdcad68dac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68da5 expref: 23 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.858231:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe7867c00/0xcf3c46fdcad68dac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68da5 expref: 23 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.858241:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380314.858263:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:3641:x1874203867447552:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380314.858268:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787380314.858306:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867447552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380314.858326:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867447424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787380314.858444:0:13187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1874203867446784:0@lo:104: 00010000:00010000:2.0:1787380314.858453:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5d46200/0xcf3c46fdcad68dba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68db3 expref: 22 pid: 6516 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380314.858463:0:13187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1874203867446912:0@lo:104: 00010000:00010000:2.0:1787380314.858471:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7867c00/0xcf3c46fdcad68dac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68da5 expref: 21 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380314.858477:0:13187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1874203867447040:0@lo:104: 00000100:00100000:1.0:1787380314.858598:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867447296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380314.858630:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380314.858677:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867447296 00000100:00100000:1.0:1787380314.858681:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867447296 00010000:00010000:1.0:1787380314.858698:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ff5d47a00/0xcf3c46fdcad68dc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68dc1 expref: 21 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380314.858713:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787380314.858718:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:3640:x1874203867447296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380314.858725:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380314.858729:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ff5d47a00/0xcf3c46fdcad68dc8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68dc1 expref: 21 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380314.858736:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ff5d47a00/0xcf3c46fdcad68dc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68dc1 expref: 21 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380314.858745:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5d47a00/0xcf3c46fdcad68dc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68dc1 expref: 21 pid: 6513 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380314.858753:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380314.858779:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:3640:x1874203867447296:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380314.858795:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787380314.859040:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867447296:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380314.859058:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380314.859085:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380314.859406:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380314.859433:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848492672 00000100:00100000:1.0:1787380314.859437:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848492672 00010000:00010000:1.0:1787380314.859453:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad68deb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab99 expref: 13 pid: 6516 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380314.859471:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 44 00000100:00100000:1.0:1787380314.859478:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2400:x1874203848492672:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380314.859486:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380314.859490:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad68deb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab99 expref: 13 pid: 6516 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380314.859499:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad68deb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab99 expref: 13 pid: 6516 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380314.859511:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380314.859544:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2400:x1874203848492672:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 66us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380314.859550:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 44 00010000:00010000:2.0:1787380314.859651:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad68deb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab99 expref: 12 pid: 6516 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380314.859663:0:13187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5dcad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1874203867446400:192.168.206.30@tcp:104: 00000100:00100000:1.0:1787380314.861469:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380314.861529:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848492800 00000100:00100000:3.0:1787380314.861536:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848492800 00010000:00010000:3.0:1787380314.861564:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68d9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab5a expref: 12 pid: 6516 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380314.861598:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 45 00000100:00100000:3.0:1787380314.861606:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2facc94b-d95a-46d6-aa1a-c4299279749f+12:2399:x1874203848492800:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380314.861619:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380314.861624:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68d9e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab5a expref: 12 pid: 6516 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.861635:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68d9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab5a expref: 12 pid: 6516 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.861652:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad68e0e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.861661:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad68e0e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.861676:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad68e0e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.861683:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad68e0e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.861690:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad68e0e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.861711:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad68e0e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.861717:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47e00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:3.0:1787380314.861721:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad68e0e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.861729:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad68e0e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.861738:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad68e0e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380314.861747:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380314.861798:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bce450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2facc94b-d95a-46d6-aa1a-c4299279749f+12:2399:x1874203848492800:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 192us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380314.861805:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 45 00010000:00010000:2.0:1787380314.862346:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5d47000/0xcf3c46fdcad68d9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab5a expref: 11 pid: 6516 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380314.862371:0:13187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13187:1874203867447168:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380314.862404:0:13187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad68e0e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380314.862413:0:13187:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad68e0e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380314.862418:0:13187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad68e0e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380314.862424:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad68e0e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380315.213281:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380315.788415:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867447808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380315.788476:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380315.788556:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380315.788563:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867447680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380315.788603:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380315.788636:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867447808 00000100:00100000:0.0:1787380315.788643:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867447808 00000100:00100000:0.0:1787380315.788683:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867447680 00000100:00100000:0.0:1787380315.788706:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867447680 00000100:00100000:0.0:1787380315.788740:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787380315.788764:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867447808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787380315.788790:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380315.788850:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867447808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380315.788858:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787380315.788874:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787380315.788880:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867447680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787380315.788889:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380315.788912:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867447680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380315.788917:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1787380315.788931:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787380315.788956:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc43e8380 x1874203867447680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380315.788994:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867447680:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787380315.789023:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5da7b80 x1874203867447808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380315.789076:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867447808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380315.789533:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867447936:0@lo:400:kworker.0 00000100:00100000:0.0:1787380315.789601:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380315.789796:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867448192:0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.789873:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380315.789975:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867448704:0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.790000:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380315.790018:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867449216:0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.790037:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380315.790057:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787380315.790062:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867448320:0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.790082:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380315.790142:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867448832:0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.790192:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380315.790220:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867448064:0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.790243:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380315.790260:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1874203867448576:0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.790281:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380315.790291:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1874203867449088:0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.790309:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380315.790360:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867448192 00000100:00100000:3.0:1787380315.790366:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867448192 00000100:00100000:3.0:1787380315.790396:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787380315.790403:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867448192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.790442:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867448192:12345-0@lo:400:kworker.0 Request processed in 40us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380315.790449:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787380315.790474:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867448704 00000100:00100000:3.0:1787380315.790477:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867448704 00000100:00100000:3.0:1787380315.790503:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867449216 00000100:00100000:3.0:1787380315.790506:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867449216 00000100:00100000:3.0:1787380315.790518:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867448320 00000100:00100000:3.0:1787380315.790520:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867448320 00000100:00100000:3.0:1787380315.790530:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867448064 00000100:00100000:3.0:1787380315.790532:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867448064 00000100:00100000:3.0:1787380315.790542:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867448576 00000100:00100000:3.0:1787380315.790544:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867448576 00000100:00100000:3.0:1787380315.790555:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867449088 00000100:00100000:3.0:1787380315.790557:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867449088 00000100:00100000:3.0:1787380315.790569:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787380315.790575:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867448704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.790614:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867448704:12345-0@lo:400:kworker.0 Request processed in 38us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380315.790620:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787380315.790634:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787380315.790640:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867449216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.790667:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867449216:12345-0@lo:400:kworker.0 Request processed in 27us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380315.790672:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787380315.790685:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787380315.790690:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867448320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.790716:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867448320:12345-0@lo:400:kworker.0 Request processed in 26us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380315.790722:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787380315.790757:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787380315.790762:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867448064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.790799:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867448064:12345-0@lo:400:kworker.0 Request processed in 33us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380315.790805:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787380315.790839:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787380315.790845:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874203867448576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.790872:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874203867448576:12345-0@lo:400:kworker.0 Request processed in 28us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380315.790877:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787380315.790889:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787380315.790895:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874203867449088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.790931:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874203867449088:12345-0@lo:400:kworker.0 Request processed in 36us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380315.790937:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787380315.790960:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867448832 00000100:00100000:3.0:1787380315.790964:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867448832 00000100:00100000:3.0:1787380315.791008:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787380315.791015:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867448832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.791044:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867448832:12345-0@lo:400:kworker.0 Request processed in 30us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380315.791049:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1787380315.791072:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787380315.791076:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787380315.791078:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787380315.791104:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867448064:0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.791115:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1874203867448576:0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.791124:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1874203867449088:0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.791149:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867448320:0@lo:400:kworker.0 00010000:00080000:3.0:1787380315.791158:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5da7480 x1874203867448832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380315.791166:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867448832:0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.791192:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867448192:0@lo:400:kworker.0 00010000:00080000:3.0:1787380315.791201:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5da6a00 x1874203867448704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380315.791210:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867448704:0@lo:400:kworker.0 00010000:00080000:3.0:1787380315.791230:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5da7b80 x1874203867449216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380315.791238:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867449216:0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.791253:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380315.791260:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867449344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380315.791285:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380315.791310:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867449344 00000100:00100000:3.0:1787380315.791314:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867449344 00000100:00100000:3.0:1787380315.791333:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787380315.791338:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867449344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787380315.791362:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787380315.791394:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867449344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380315.791400:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787380315.791431:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867449344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380315.791538:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867448448:0@lo:400:kworker.0 00000100:00100000:0.0:1787380315.791561:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380315.791585:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867448960:0@lo:400:kworker.0 00000100:00100000:0.0:1787380315.791606:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380315.791637:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867448960 00000100:00100000:0.0:1787380315.791640:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867448960 00000100:00100000:0.0:1787380315.791670:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787380315.791675:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867448960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380315.791706:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867448960:12345-0@lo:400:kworker.0 Request processed in 31us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380315.791712:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1787380315.791730:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787380315.791749:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5da6300 x1874203867448960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380315.791758:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867448960:0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.792038:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867448448 00000100:00100000:3.0:1787380315.792043:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867448448 00000100:00100000:3.0:1787380315.792106:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787380315.792113:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867448448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380315.792158:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867448448:12345-0@lo:400:kworker.0 Request processed in 45us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380315.792166:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787380315.792231:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867448448:0@lo:400:kworker.0 00000100:00100000:2.0:1787380315.793516:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867447936 00000100:00100000:2.0:1787380315.793526:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867447936 00000100:00100000:2.0:1787380315.797078:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1787380315.797090:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:3641:x1874203867447936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380315.797191:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:3641:x1874203867447936:12345-0@lo:400:kworker.0 Request processed in 102us (7605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380315.797199:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1787380315.797338:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867447936:0@lo:400:kworker.0 00010000:00010000:1.0:1787380316.239596:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380316.300008:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787380316.300029:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867449472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380316.300099:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380316.300162:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867449472 00000100:00100000:1.0:1787380316.300178:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867449472 00000100:00100000:1.0:1787380316.300220:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787380316.300229:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867449472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787380316.300254:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380316.300294:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867449472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380316.300301:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:1.0:1787380316.300339:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc43e8a80 x1874203867449472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380316.300356:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867449472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380316.300854:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787380316.300865:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867449600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787380316.300897:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380316.300983:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867449600 00000100:00100000:0.0:1787380316.300988:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867449600 00000100:00100000:0.0:1787380316.301023:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787380316.301037:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867449600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787380316.301049:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380316.301086:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867449600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380316.301091:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:0.0:1787380316.301118:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5d9b480 x1874203867449600/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380316.301130:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d9b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867449600:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380316.321050:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380316.321086:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380316.321119:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380316.321146:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848493056 00000100:00100000:0.0:1787380316.321155:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848493056 00000100:00100000:0.0:1787380316.321215:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848493312 00000100:00100000:0.0:1787380316.321218:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848493312 00000100:00100000:0.0:1787380316.321240:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 187 00000100:00100000:0.0:1787380316.321248:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2399:x1874203848493056:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380316.321315:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2399:x1874203848493056:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 66us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380316.321322:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 187 00000100:00100000:0.0:1787380316.321338:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 188 00000100:00100000:0.0:1787380316.321345:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2399:x1874203848493312:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380316.321370:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2399:x1874203848493312:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 25us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380316.321376:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 188 00000100:00100000:0.0:1787380316.321401:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848492928 00000100:00100000:0.0:1787380316.321404:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848492928 00000100:00100000:0.0:1787380316.321429:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 313 00000100:00100000:0.0:1787380316.321435:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+11:2399:x1874203848492928:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380316.321461:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+11:2399:x1874203848492928:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 26us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380316.321468:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 313 00000100:00080000:0.0:1787380316.321491:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380316.329122:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380316.329176:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380316.329205:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848493184 00000100:00100000:3.0:1787380316.329215:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848493184 00000100:00100000:3.0:1787380316.329274:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848493440 00000100:00100000:3.0:1787380316.329277:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848493440 00000100:00100000:3.0:1787380316.329314:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 189 00000100:00100000:3.0:1787380316.329323:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848493184:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380316.329390:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848493184:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 68us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380316.329398:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 189 00000100:00100000:0.0:1787380316.329420:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 190 00000100:00100000:0.0:1787380316.329429:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2399:x1874203848493440:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380316.329457:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2399:x1874203848493440:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 30us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380316.331114:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 190 00000100:00080000:3.0:1787380316.331232:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787380316.573878:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380316.574052:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848493568 00000100:00100000:1.0:1787380316.574061:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848493568 00000100:00100000:1.0:1787380316.574122:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 314 00000100:00100000:1.0:1787380316.574132:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+11:6169:x1874203848493568:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380316.574147:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380316.574175:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68e15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0abca expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380316.574200:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68e15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abca expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380316.574211:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68e15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abca expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380316.574220:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc165ac00, rc 0) 00000100:00100000:1.0:1787380316.574418:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+12:6169:x1874203848493568:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 Request processed in 287us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380316.574425:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 314 00000100:00100000:0.0:1787380316.581742:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380316.581851:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848493696 00000100:00100000:1.0:1787380316.581860:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848493696 00000100:00100000:1.0:1787380316.581907:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 315 00000100:00100000:1.0:1787380316.581917:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+12:6169:x1874203848493696:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380316.582054:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+12:6169:x1874203848493696:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 Request processed in 137us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380316.582061:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 315 00000100:00100000:3.0:1787380316.586296:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380316.586356:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848493824 00000100:00100000:2.0:1787380316.586370:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848493824 00000100:00100000:2.0:1787380316.586440:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 316 00000100:00100000:2.0:1787380316.586454:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+12:6169:x1874203848493824:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380316.586592:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+12:6169:x1874203848493824:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 Request processed in 143us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380316.586599:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 316 00000100:00100000:3.0:1787380316.598282:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380316.598479:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848493952 00000100:00100000:0.0:1787380316.598489:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848493952 00000100:00100000:0.0:1787380316.598535:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 317 00000100:00100000:0.0:1787380316.598545:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+12:6169:x1874203848493952:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380316.598560:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380316.598579:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7867800/0xcf3c46fdcad68e1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0abd1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380316.598605:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7867800/0xcf3c46fdcad68e1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abd1 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380316.598625:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7867800/0xcf3c46fdcad68e1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abd1 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380316.598633:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867800, rc 0) 00000100:00100000:0.0:1787380316.598683:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:6169:x1874203848493952:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 Request processed in 140us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380316.598690:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 317 00000100:00100000:2.0:1787380316.616461:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380316.618862:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848494080 00000100:00100000:0.0:1787380316.618877:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848494080 00000100:00100000:0.0:1787380316.618944:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 318 00000100:00100000:0.0:1787380316.618955:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:6169:x1874203848494080:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380316.619131:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:6169:x1874203848494080:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 Request processed in 178us (2691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380316.619139:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 318 00000100:00100000:0.0:1787380316.623711:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380316.623786:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848494208 00000100:00100000:2.0:1787380316.623795:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848494208 00000100:00100000:2.0:1787380316.623872:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 319 00000100:00100000:2.0:1787380316.623882:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:6169:x1874203848494208:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380316.624017:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:6169:x1874203848494208:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 Request processed in 135us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380316.624025:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 319 10000000:01000000:0.0:1787380316.820779:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787380316.820786:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fff5a3000 from 7 10000000:01000000:0.0:1787380316.820791:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787380316.820849:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad68e23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380316.820862:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad68e23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380316.820873:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad68e23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380316.821764:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867449728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787380316.821850:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380316.821882:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867449728 00000100:00100000:1.0:1787380316.821890:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867449728 00000100:00100000:1.0:1787380316.821941:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1787380316.821950:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867449728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380316.821962:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380316.821986:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68e2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68e23 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380316.822558:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68e2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68e23 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380316.822571:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68e2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68e23 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380316.822580:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc165be00, rc 0) 00000100:00100000:1.0:1787380316.822617:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867449728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 669us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380316.822624:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1787380316.822681:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb45cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787380316.822701:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867449728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380316.822714:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad68e23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68e2a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380316.822723:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad68e23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68e2a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380316.822783:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867449856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380316.822832:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380316.822846:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4ec0780 going to sleep for 11 seconds 00000100:00100000:0.0:1787380316.822977:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867449856 00000100:00100000:0.0:1787380316.822982:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867449856 00000100:00100000:0.0:1787380316.823005:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1787380316.823012:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867449856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380316.823758:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867449856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 743us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380316.823766:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787380316.823862:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867449856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380316.823907:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867449984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380316.823950:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380316.823986:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4ec0780 going to sleep for 11 seconds 00000100:00100000:0.0:1787380316.824098:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867449984 00000100:00100000:0.0:1787380316.824103:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867449984 00000100:00100000:0.0:1787380316.824247:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787380316.824255:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867449984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380316.824339:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867449984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380316.824346:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1787380316.824392:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867449984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787380316.826484:0:13285:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787380316.826736:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787380316.826757:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787380316.826766:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad68e23 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68e2a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380316.826777:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad68e23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68e2a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380316.826802:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787380316.826805:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ff5cad800 from 7 10000000:01000000:0.0:1787380316.826877:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787380316.828196:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867600/0xcf3c46fdcad68e31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380316.828212:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867600/0xcf3c46fdcad68e31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380316.828223:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867600/0xcf3c46fdcad68e31 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380316.828249:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867450112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787380316.828309:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380316.828356:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb45cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380316.828829:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867450112 00000100:00100000:3.0:1787380316.828837:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867450112 00000100:00100000:3.0:1787380316.828894:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1787380316.828905:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867450112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380316.828919:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380316.828932:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5fda600/0xcf3c46fdcad68e38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68e31 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380316.828955:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5fda600/0xcf3c46fdcad68e38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68e31 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380316.828965:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5fda600/0xcf3c46fdcad68e38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68e31 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380316.828975:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fda600, rc 0) 00000100:00100000:3.0:1787380316.829019:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867450112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380316.829028:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1787380316.829304:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867450112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380316.829320:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867600/0xcf3c46fdcad68e31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68e38 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380316.829328:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867600/0xcf3c46fdcad68e31 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68e38 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380316.829385:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867450240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380316.829411:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380316.830132:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb45cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380316.836010:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867450240 00000100:00100000:3.0:1787380316.836025:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867450240 00000100:00100000:3.0:1787380316.836086:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1787380316.836096:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867450240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380316.836262:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867450240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (6849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380316.836270:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787380316.836302:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867450240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380316.836352:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867450368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380316.836398:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380316.836432:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4ec0180 going to sleep for 11 seconds 00000100:00100000:3.0:1787380316.837533:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867450368 00000100:00100000:3.0:1787380316.837543:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867450368 00000100:00100000:3.0:1787380316.837593:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1787380316.837602:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867450368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380316.838361:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867450368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 757us (1960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380316.838370:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1787380316.838692:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867450368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787380316.840863:0:13286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787380316.840999:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787380316.841027:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787380316.841038:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867600/0xcf3c46fdcad68e31 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68e38 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380316.841050:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867600/0xcf3c46fdcad68e31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68e38 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380316.841061:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787380316.841064:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ff3dad800 from 7 10000000:01000000:3.0:1787380316.841067:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787380316.841099:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbe00/0xcf3c46fdcad68e3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380316.841108:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbe00/0xcf3c46fdcad68e3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380316.841129:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbe00/0xcf3c46fdcad68e3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380316.841150:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867450496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787380316.841213:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380316.841259:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fe0480 going to sleep for 11 seconds 00000100:00100000:1.0:1787380316.841260:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867450496 00000100:00100000:1.0:1787380316.841268:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867450496 00000100:00100000:1.0:1787380316.841311:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1787380316.841318:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867450496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380316.841346:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380316.841357:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fc165ba00/0xcf3c46fdcad68e46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68e3f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380316.841387:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fc165ba00/0xcf3c46fdcad68e46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68e3f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380316.841501:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fc165ba00/0xcf3c46fdcad68e46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68e3f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380316.841509:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc165ba00, rc 0) 00000100:00100000:1.0:1787380316.841600:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867450496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 281us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380316.841607:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1787380316.843041:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867450496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380316.844645:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbe00/0xcf3c46fdcad68e3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68e46 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380316.844662:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbe00/0xcf3c46fdcad68e3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68e46 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380316.844745:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867450624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380316.844983:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380316.845028:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fe0480 going to sleep for 11 seconds 00000100:00100000:0.0:1787380316.845342:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867450624 00000100:00100000:0.0:1787380316.845350:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867450624 00000100:00100000:0.0:1787380316.845410:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1787380316.845419:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867450624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380316.845544:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867450624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380316.845552:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1787380316.845654:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867450624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380316.845688:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867450752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380316.845737:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380316.845768:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4ec0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380316.845833:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867450752 00000100:00100000:3.0:1787380316.845837:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867450752 00000100:00100000:3.0:1787380316.845869:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1787380316.845876:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867450752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380316.845948:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867450752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380316.845955:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1787380316.846242:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867450752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787380316.848891:0:13287:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787380316.848989:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787380316.849202:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787380316.849214:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbe00/0xcf3c46fdcad68e3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68e46 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380316.849225:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbe00/0xcf3c46fdcad68e3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68e46 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380316.849249:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787380316.849252:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fc873b000 from 7 10000000:01000000:1.0:1787380316.849254:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787380316.849289:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68e4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380316.849297:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68e4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380316.849306:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68e4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380316.849331:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867450880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787380316.849387:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380316.849545:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4ec0180 going to sleep for 11 seconds 00000100:00100000:0.0:1787380316.849904:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867450880 00000100:00100000:0.0:1787380316.849912:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867450880 00000100:00100000:0.0:1787380316.849962:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1787380316.849971:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867450880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380316.849984:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380316.849996:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68e54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68e4d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380316.850019:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68e54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68e4d expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380316.850029:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68e54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68e4d expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380316.850037:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866200, rc 0) 00000100:00100000:0.0:1787380316.850086:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:6518:x1874203867450880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380316.850093:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1787380316.850210:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867450880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380316.850222:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68e4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68e54 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380316.850232:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68e4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68e54 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380316.850284:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867451008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380316.850311:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380316.850339:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4ec0180 going to sleep for 11 seconds 00000100:00100000:0.0:1787380316.854989:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867451008 00000100:00100000:0.0:1787380316.855005:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867451008 00000100:00100000:0.0:1787380316.855067:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1787380316.855077:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:6518:x1874203867451008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380316.855264:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:6518:x1874203867451008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 188us (4951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380316.855272:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1787380316.855330:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867451008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380316.855378:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867451136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380316.855428:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380316.855457:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5d58c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380316.855472:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867451136 00000100:00100000:0.0:1787380316.855475:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867451136 00000100:00100000:0.0:1787380316.855498:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1787380316.855504:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:6518:x1874203867451136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380316.855575:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:6518:x1874203867451136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380316.855582:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1787380316.855633:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34efb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867451136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787380316.856212:0:13288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787380316.856562:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787380316.856585:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787380316.856601:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68e4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68e54 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380316.856613:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68e4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68e54 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380317.262870:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380317.330084:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867451264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787380317.330146:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380317.330217:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867451264 00000100:00100000:2.0:1787380317.330223:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867451264 00000100:00100000:2.0:1787380317.330260:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787380317.330267:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867451264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787380317.330297:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787380317.330337:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867451264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380317.330344:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787380317.330383:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867451264:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787380318.283910:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787380318.525075:0:13386:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787380319.311581:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380320.332948:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380320.908195:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867451392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787380320.908275:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380320.908404:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867451392 00000100:00100000:0.0:1787380320.908411:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867451392 00000100:00100000:0.0:1787380320.908462:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787380320.908472:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867451392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787380320.908497:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380320.908540:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867451392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380320.908546:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:0.0:1787380320.908581:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc43ea680 x1874203867451392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380320.908610:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867451392:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787380320.908889:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787380320.909219:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787380320.909230:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867451520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380320.909274:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380320.909362:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867451520 00000100:00100000:0.0:1787380320.909368:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867451520 00000100:00100000:0.0:1787380320.909404:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787380320.909411:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867451520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787380320.909423:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380320.909452:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867451520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380320.909458:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787380320.909758:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380320.909768:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867451648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380320.909798:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380320.909999:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867451648 00000100:00100000:0.0:1787380320.910004:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867451648 00000100:00100000:0.0:1787380320.910035:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787380320.910042:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867451648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787380320.910063:0:13003:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787380320.910094:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867451648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380320.910100:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787380320.910451:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867451904:0@lo:400:kworker.0 00000100:00100000:1.0:1787380320.910481:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380320.910498:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867452416:0@lo:400:kworker.0 00000100:00100000:1.0:1787380320.910517:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380320.910530:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec2605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1874203867452928:0@lo:400:kworker.0 00000100:00100000:1.0:1787380320.910546:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380320.910559:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787380320.910563:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867451776:0@lo:400:kworker.0 00000100:00100000:1.0:1787380320.910587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380320.910605:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1874203867452288:0@lo:400:kworker.0 00000100:00100000:1.0:1787380320.910624:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380320.910635:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec361c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1874203867452800:0@lo:400:kworker.0 00000100:00100000:1.0:1787380320.910650:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380320.910723:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867451776 00000100:00100000:0.0:1787380320.910728:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867451776 00000100:00100000:0.0:1787380320.910763:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1787380320.910770:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3640:x1874203867451776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380320.910806:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3640:x1874203867451776:12345-0@lo:400:kworker.0 Request processed in 37us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380320.910842:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1787380320.910881:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867451904 00000100:00100000:0.0:1787380320.910896:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867451904 00000100:00100000:0.0:1787380320.910913:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867452416 00000100:00100000:0.0:1787380320.910916:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867452416 00000100:00100000:0.0:1787380320.910930:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867452928 00000100:00100000:0.0:1787380320.910932:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867452928 00000100:00100000:0.0:1787380320.910942:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867452288 00000100:00100000:0.0:1787380320.910944:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867452288 00000100:00100000:0.0:1787380320.910953:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867452800 00000100:00100000:0.0:1787380320.910955:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867452800 00000100:00100000:0.0:1787380320.910967:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787380320.910972:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867451904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380320.911004:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2607b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867451904:12345-0@lo:400:kworker.0 Request processed in 32us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380320.911011:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787380320.911021:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787380320.911027:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867452416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380320.911055:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2605180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867452416:12345-0@lo:400:kworker.0 Request processed in 28us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380320.911060:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787380320.911072:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787380320.911078:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874203867452928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380320.911106:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2604e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874203867452928:12345-0@lo:400:kworker.0 Request processed in 28us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380320.911111:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1787380320.911122:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787380320.911127:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874203867452288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380320.911165:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2606a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874203867452288:12345-0@lo:400:kworker.0 Request processed in 37us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380320.911179:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787380320.911191:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787380320.911197:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874203867452800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380320.911226:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2607480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874203867452800:12345-0@lo:400:kworker.0 Request processed in 29us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380320.911232:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787380320.911283:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867451776:0@lo:400:kworker.0 00000100:00100000:0.0:1787380320.911296:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1874203867452288:0@lo:400:kworker.0 00000100:00100000:0.0:1787380320.911305:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec361c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1874203867452800:0@lo:400:kworker.0 00000100:00100000:0.0:1787380320.911315:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867451904:0@lo:400:kworker.0 00010000:00080000:0.0:1787380320.911326:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc43e9f80 x1874203867452416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380320.911336:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867452416:0@lo:400:kworker.0 00010000:00080000:0.0:1787380320.911346:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec2605f80 x1874203867452928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380320.911354:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec2605f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1874203867452928:0@lo:400:kworker.0 00000100:00080000:2.0:1787380320.911751:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380320.911755:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787380320.911758:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787380320.911772:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867452160:0@lo:400:kworker.0 00000100:00100000:2.0:1787380320.911841:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380320.911882:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867452672:0@lo:400:kworker.0 00000100:00100000:2.0:1787380320.911906:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787380320.911936:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5da5880 x1874203867451520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380320.911952:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867451520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380320.911965:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787380320.911969:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867452032:0@lo:400:kworker.0 00000100:00100000:2.0:1787380320.911990:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380320.912006:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867452544:0@lo:400:kworker.0 00000100:00100000:2.0:1787380320.912040:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380320.912065:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867452672 00000100:00100000:2.0:1787380320.912070:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867452672 00000100:00100000:2.0:1787380320.912105:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867452544 00000100:00100000:2.0:1787380320.912108:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867452544 00000100:00100000:2.0:1787380320.912128:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787380320.912134:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867452672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380320.912182:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867452672:12345-0@lo:400:kworker.0 Request processed in 47us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380320.912188:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787380320.912201:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787380320.912207:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867452544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380320.912502:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867452544:12345-0@lo:400:kworker.0 Request processed in 294us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380320.912509:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1787380320.912530:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787380320.912548:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc43ea680 x1874203867452544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380320.912557:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867452544:0@lo:400:kworker.0 00010000:00080000:2.0:1787380320.912567:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5f09880 x1874203867452672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380320.912575:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867452672:0@lo:400:kworker.0 00000100:00100000:2.0:1787380320.912594:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867452032 00000100:00100000:2.0:1787380320.912598:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867452032 00000100:00100000:2.0:1787380320.912621:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787380320.912627:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867452032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380320.912660:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867452032:12345-0@lo:400:kworker.0 Request processed in 33us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380320.912665:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787380320.912690:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867452032:0@lo:400:kworker.0 00000100:00100000:3.0:1787380320.912886:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867452160 00000100:00100000:3.0:1787380320.912890:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867452160 00000100:00100000:3.0:1787380320.912924:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787380320.912932:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867452160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380320.912971:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867452160:12345-0@lo:400:kworker.0 Request processed in 41us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380320.912977:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787380320.913030:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867451648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380320.913052:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867452160:0@lo:400:kworker.0 00010000:00010000:3.0:1787380321.355963:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380321.424036:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380321.424056:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867453056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380321.424116:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380321.424197:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867453056 00000100:00100000:0.0:1787380321.424203:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867453056 00000100:00100000:0.0:1787380321.424255:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787380321.424275:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867453056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380321.424301:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380321.424358:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867453056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380321.424365:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:0.0:1787380321.424398:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34ef480 x1874203867453056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380321.424415:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867453056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380321.424992:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867453184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380321.425022:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380321.425104:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867453184 00000100:00100000:2.0:1787380321.425110:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867453184 00000100:00100000:2.0:1787380321.425153:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787380321.425160:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867453184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787380321.425172:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380321.425204:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867453184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380321.425221:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:0.0:1787380321.425472:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5da5f80 x1874203867453184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380321.425487:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867453184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787380321.440984:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380321.441162:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380321.441193:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380321.441216:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380321.441254:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380321.441279:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848494592 00000100:00100000:2.0:1787380321.441286:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848494592 00000100:00100000:2.0:1787380321.441333:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848494848 00000100:00100000:2.0:1787380321.441336:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848494848 00000100:00100000:2.0:1787380321.441352:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848494464 00000100:00100000:2.0:1787380321.441354:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848494464 00000100:00100000:2.0:1787380321.441366:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848494720 00000100:00100000:2.0:1787380321.441369:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848494720 00000100:00100000:2.0:1787380321.441384:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 197 00000100:00100000:2.0:1787380321.441392:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2397:x1874203848494592:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380321.441456:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2397:x1874203848494592:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 64us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380321.441463:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 197 00000100:00100000:2.0:1787380321.441480:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 198 00000100:00100000:2.0:1787380321.441487:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848494848:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380321.441514:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848494848:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 28us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380321.441520:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 198 00000100:00100000:2.0:1787380321.441531:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 199 00000100:00100000:2.0:1787380321.441540:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2397:x1874203848494464:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380321.441576:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2397:x1874203848494464:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 39us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380321.441583:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 199 00000100:00100000:2.0:1787380321.441598:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 200 00000100:00100000:2.0:1787380321.441605:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848494720:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380321.441631:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848494720:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 27us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380321.441638:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 200 00000100:00080000:2.0:1787380321.442679:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380321.442685:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787380321.443051:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848494336 00000100:00100000:1.0:1787380321.443065:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848494336 00000100:00100000:0.0:1787380321.443311:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 333 00000100:00100000:0.0:1787380321.443322:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2397:x1874203848494336:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380321.443384:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2397:x1874203848494336:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 64us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380321.443391:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 333 00010000:00010000:1.0:1787380322.380799:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380322.445616:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec2606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867453312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787380322.445684:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380322.445952:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867453312 00000100:00100000:1.0:1787380322.445960:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867453312 00000100:00100000:1.0:1787380322.446015:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787380322.446025:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867453312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380322.446057:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380322.446104:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867453312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380322.446111:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787380322.446213:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec2606d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867453312:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787380323.407616:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787380323.568620:0:13534:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 02:32:02 (1787380322) === 00000100:00100000:2.0:1787380323.777407:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380323.777453:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380323.777587:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848494976 00000100:00100000:3.0:1787380323.777596:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848494976 00000100:00100000:3.0:1787380323.777668:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00100000:3.0:1787380323.777678:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2398:x1874203848494976:12345-192.168.206.30@tcp:41:mkdir.0 00000004:00000024:3.0:1787380323.777712:0:10154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787380323.777782:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2398:x1874203848494976:12345-192.168.206.30@tcp:41:mkdir.0 Request processed in 105us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380323.777789:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00080000:2.0:1787380323.777932:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380323.781064:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848495104 00000100:00100000:0.0:1787380323.781078:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848495104 00000100:00100000:0.0:1787380323.781150:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:0.0:1787380323.781161:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:10484:x1874203848495104:12345-192.168.206.30@tcp:700:mkdir.0 00000100:00100000:0.0:1787380323.781436:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:10484:x1874203848495104:12345-192.168.206.30@tcp:700:mkdir.0 Request processed in 276us (3980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380323.781457:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:2.0:1787380323.788198:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380323.788286:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848495360 00000100:00100000:0.0:1787380323.788295:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848495360 00000100:00100000:0.0:1787380323.788351:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:0.0:1787380323.788361:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:10484:x1874203848495360:12345-192.168.206.30@tcp:36:mkdir.0 00010000:00010000:0.0:1787380323.788411:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380323.788476:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad68cfd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab45 expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380323.788495:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25a8800) 00010000:00010000:0.0:1787380323.788505:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380323.788592:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68e5b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380323.788605:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68e5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380323.788614:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68e5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380323.788647:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68e62 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380323.788656:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68e62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380323.788663:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68e62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380323.789450:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68e69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380323.789467:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68e69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380323.789475:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68e69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787380323.789491:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c31b48c reply state 0000000022f620fd transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68e69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380323.789501:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68e69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380323.789507:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d6ec26f4b00) 00010000:00010000:0.0:1787380323.789509:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787380323.789671:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787380323.789678:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787380323.789686:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68e5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380323.789692:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68e5b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380323.789698:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68e5b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380323.789703:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380323.789706:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68e5b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380323.789713:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68e5b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380323.789732:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec26f4800) 00010000:00010000:0.0:1787380323.789735:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380323.789738:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68e5b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380323.789744:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68e5b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787380323.789759:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001c31b48c reply state 0000000022f620fd transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68e62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380323.789769:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68e62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380323.789776:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d6ec26f4d00) 00010000:00010000:0.0:1787380323.789778:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787380323.789781:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1787380323.790056:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:10484:x1874203848495360:12345-192.168.206.30@tcp:36:mkdir.0 Request processed in 1693us (1864us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787380323.790065:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:3.0:1787380323.804388:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380323.807254:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848495488 00000100:00100000:2.0:1787380323.807269:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848495488 00000100:00100000:2.0:1787380323.807334:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:2.0:1787380323.807345:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:10485:x1874203848495488:12345-192.168.206.30@tcp:101:chmod.0 00010000:00010000:2.0:1787380323.807365:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380323.807385:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47a00/0xcf3c46fdcad68e70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0abd8 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.807443:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68e77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.807473:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68e77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.807483:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68e77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380323.807527:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787380323.807530:0:10154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787380323.807563:0:10154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68e77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.807588:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47a00/0xcf3c46fdcad68e70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abd8 expref: 9 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.807606:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68e77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abd8 expref: 8 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.807614:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25a8600) 00010000:00010000:2.0:1787380323.807617:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787380323.807620:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46600, rc 0) 00000100:00100000:2.0:1787380323.809488:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:10485:x1874203848495488:12345-192.168.206.30@tcp:101:chmod.0 Request processed in 2130us (5095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380323.809501:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:1.0:1787380323.814440:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380323.814515:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848495744 00000100:00100000:2.0:1787380323.814524:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848495744 00000100:00100000:2.0:1787380323.814578:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:2.0:1787380323.814587:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:10485:x1874203848495744:12345-192.168.206.30@tcp:36:chmod.0 00010000:00010000:2.0:1787380323.814636:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380323.814675:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68e77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abd8 expref: 8 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.814694:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25a8600) 00010000:00010000:2.0:1787380323.814703:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380323.814726:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68e7e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.814737:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68e7e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.814747:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68e7e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380323.814973:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000340de2be reply state 000000005b4895ea transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68e7e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.814997:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68e7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.815004:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25a8e00) 00010000:00010000:2.0:1787380323.815006:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787380323.815009:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787380323.815016:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787380323.815087:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2606d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:10485:x1874203848495744:12345-192.168.206.30@tcp:36:chmod.0 Request processed in 501us (654us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787380323.815094:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:3.0:1787380323.864413:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380323.865371:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848495872 00000100:00100000:2.0:1787380323.865382:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848495872 00000100:00100000:2.0:1787380323.865445:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 26 00000100:00100000:2.0:1787380323.865456:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:10486:x1874203848495872:12345-192.168.206.30@tcp:101:chown.0 00010000:00010000:2.0:1787380323.865488:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380323.865507:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68e85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0abdf expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.865570:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47a00/0xcf3c46fdcad68e8c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.865585:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47a00/0xcf3c46fdcad68e8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.865596:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47a00/0xcf3c46fdcad68e8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380323.865636:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787380323.865640:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787380323.865682:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47a00/0xcf3c46fdcad68e8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.865710:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68e85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abdf expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.865731:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47a00/0xcf3c46fdcad68e8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abdf expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.865740:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25a8e00) 00010000:00010000:2.0:1787380323.865743:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787380323.865746:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d47a00, rc 0) 00000100:00100000:2.0:1787380323.865859:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+10:10486:x1874203848495872:12345-192.168.206.30@tcp:101:chown.0 Request processed in 405us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380323.865885:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 26 00000100:00100000:3.0:1787380323.879982:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380323.881512:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848496000 00000100:00100000:2.0:1787380323.881525:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848496000 00000100:00100000:2.0:1787380323.881637:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 27 00000100:00100000:2.0:1787380323.881647:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+10:10486:x1874203848496000:12345-192.168.206.30@tcp:101:chown.0 00010000:00010000:2.0:1787380323.881665:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380323.881684:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68e93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0abe6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.881744:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad68e9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.881756:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad68e9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.881768:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad68e9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.881779:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68ea1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.881786:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.881793:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.881894:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad68ea8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.881904:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad68ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.881926:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad68ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380323.881984:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787380323.881987:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787380323.882004:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad68ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.882015:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad68e9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.882022:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad68e9a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.882028:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad68e9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.882034:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46c00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380323.882037:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad68e9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.882044:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad68e9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.882057:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25a8e00) 00010000:00010000:2.0:1787380323.882060:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380323.882064:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad68e9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.882070:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad68e9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.882094:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.882100:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68ea1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.882106:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.882111:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380323.882114:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.882120:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68ea1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.882140:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d6ec26f4d00) 00010000:00010000:2.0:1787380323.882143:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380323.882146:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68ea1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.882152:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68ea1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.882179:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68e93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abe6 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.882192:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad68ea8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abe6 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.882209:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d6ec26f4b00) 00010000:00010000:2.0:1787380323.882212:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787380323.882214:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46800, rc 0) 00000100:00100000:2.0:1787380323.882273:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+11:10486:x1874203848496000:12345-192.168.206.30@tcp:101:chown.0 Request processed in 628us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380323.882281:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 27 00000100:00100000:1.0:1787380323.885416:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380323.885514:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848496128 00000100:00100000:2.0:1787380323.885522:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848496128 00000100:00100000:2.0:1787380323.885612:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:2.0:1787380323.885622:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+11:10486:x1874203848496128:12345-192.168.206.30@tcp:900:chown.0 00000100:00100000:2.0:1787380323.885704:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2605f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+11:10486:x1874203848496128:12345-192.168.206.30@tcp:900:chown.0 Request processed in 83us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380323.885711:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:3.0:1787380323.904796:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380323.904926:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848496384 00000100:00100000:2.0:1787380323.904935:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848496384 00000100:00100000:2.0:1787380323.904999:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 28 00000100:00100000:2.0:1787380323.905018:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+11:10486:x1874203848496384:12345-192.168.206.30@tcp:36:chown.0 00010000:00010000:2.0:1787380323.905070:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380323.905094:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad68ea8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abe6 expref: 11 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.905112:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d6ec26f4b00) 00010000:00010000:2.0:1787380323.905117:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380323.905146:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68eaf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.905180:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68eaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.905190:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68eaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787380323.912772:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1787380323.912932:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68e62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.912953:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68e62 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.912961:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68e62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.912968:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380323.912972:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68e62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.912979:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68e62 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.912994:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d6ec26f4d00) 00010000:00010000:3.0:1787380323.912998:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380323.913002:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68e62 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913008:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68e62 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913027:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68e69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913034:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68e69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913040:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68e69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913045:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380323.913052:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68e69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913058:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68e69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913066:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d6ec26f4b00) 00010000:00010000:3.0:1787380323.913069:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380323.913071:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68e69 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913078:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68e69 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913088:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68e7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913094:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68e7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913100:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68e7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913105:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47c00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380323.913108:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68e7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913113:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68e7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913120:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25a8e00) 00010000:00010000:3.0:1787380323.913121:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787380323.913138:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68e7e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913144:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68e7e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380323.913268:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000067ba128 reply state 0000000060343595 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68eaf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.913282:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68eaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.913289:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d6ec26f4b00) 00010000:00010000:2.0:1787380323.913291:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1787380323.913294:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787380323.913304:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1787380323.913379:0:6523:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787380323.913395:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:10486:x1874203848496384:12345-192.168.206.30@tcp:36:chown.0 Request processed in 8385us (8604us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787380323.913404:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 28 00010000:00010000:3.0:1787380323.913771:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68eaf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913779:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68eaf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913785:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68eaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913790:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380323.913793:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68eaf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913800:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68eaf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913838:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d6ec26f4b00) 00010000:00010000:3.0:1787380323.913841:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787380323.913844:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68eaf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.913850:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68eaf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380323.949000:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380323.949068:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848496512 00000100:00100000:0.0:1787380323.949078:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848496512 00000100:00100000:0.0:1787380323.949143:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 29 00000100:00100000:0.0:1787380323.949152:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:10487:x1874203848496512:12345-192.168.206.30@tcp:101:touch.500 00010000:00010000:0.0:1787380323.949174:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380323.949194:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68eb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0abed expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787380323.952689:0:6521:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3445us 00010000:00010000:1.0:1787380323.960489:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad68ebd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960509:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad68ebd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960522:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad68ebd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960538:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9a800/0xcf3c46fdcad68ec4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960545:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9a800/0xcf3c46fdcad68ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960562:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9a800/0xcf3c46fdcad68ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960677:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9be00/0xcf3c46fdcad68ecb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960686:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9be00/0xcf3c46fdcad68ecb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960693:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9be00/0xcf3c46fdcad68ecb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380323.960721:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787380323.960725:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787380323.960754:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9be00/0xcf3c46fdcad68ecb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960766:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad68ebd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960772:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad68ebd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960778:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad68ebd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960785:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165ae00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380323.960789:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad68ebd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960796:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad68ebd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960850:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25a8e00) 00010000:00010000:1.0:1787380323.960854:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380323.960858:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad68ebd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960864:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad68ebd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960876:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9a800/0xcf3c46fdcad68ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960883:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9a800/0xcf3c46fdcad68ec4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960889:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9a800/0xcf3c46fdcad68ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960895:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9a800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380323.960898:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9a800/0xcf3c46fdcad68ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960903:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9a800/0xcf3c46fdcad68ec4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960910:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d6fc4e52900) 00010000:00010000:1.0:1787380323.960912:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380323.960915:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9a800/0xcf3c46fdcad68ec4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960920:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9a800/0xcf3c46fdcad68ec4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960965:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68eb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abed expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960978:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9be00/0xcf3c46fdcad68ecb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abed expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.960985:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d6fc4e52d00) 00010000:00010000:1.0:1787380323.960987:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787380323.960990:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9be00, rc 0) 00000100:00100000:1.0:1787380323.961050:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:10487:x1874203848496512:12345-192.168.206.30@tcp:101:touch.500 Request processed in 11899us (12057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380323.961058:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 29 00000100:00100000:2.0:1787380323.963121:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380323.963198:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848496768 00000100:00100000:3.0:1787380323.963207:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848496768 00000100:00100000:3.0:1787380323.963266:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 30 00000100:00100000:3.0:1787380323.963275:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:10487:x1874203848496768:12345-192.168.206.30@tcp:101:touch.500 00010000:00010000:3.0:1787380323.963294:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380323.963309:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad68ed2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0abf4 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.963399:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ed9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.963410:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ed9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.963420:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ed9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.963480:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad68ee0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.963488:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad68ee0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.963495:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad68ee0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787380323.963866:0:10154:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787380323.964167:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad68ee7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.964176:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad68ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.964184:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad68ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.964217:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ed9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.964224:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ed9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.964230:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ed9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.964235:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdba00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380323.964239:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ed9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.964245:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ed9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.964255:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d6fc4e52d00) 00010000:00010000:3.0:1787380323.964257:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380323.964261:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ed9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.964266:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ed9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787380323.964277:0:10154:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009797a9a8 reply state 000000009891e299 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad68ee0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.964286:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad68ee0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.964292:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xdc94a951 (ffff9d6ec241bd00) 00010000:00010000:3.0:1787380323.964297:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787380323.964300:0:10154:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787380323.964323:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad68ed2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abf4 expref: 10 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.964334:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad68ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abf4 expref: 9 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380323.964341:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d6ec241bc00) 00010000:00010000:3.0:1787380323.964343:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380323.964345:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fdb600, rc 0) 00000100:00100000:3.0:1787380323.964401:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+10:10487:x1874203848496768:12345-192.168.206.30@tcp:101:touch.500 Request processed in 1126us (1287us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787380323.964408:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 30 00000100:00100000:0.0:1787380323.966682:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380323.966770:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848497024 00000100:00100000:2.0:1787380323.966779:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848497024 00000100:00100000:2.0:1787380323.966853:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 31 00000100:00100000:2.0:1787380323.966863:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+10:10487:x1874203848497024:12345-192.168.206.30@tcp:36:touch.500 00010000:00010000:2.0:1787380323.966924:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380323.966948:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad68ee7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abf4 expref: 10 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.966978:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d6ec241bc00) 00010000:00010000:2.0:1787380323.966996:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380323.967045:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad68ef5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.967057:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad68ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.967066:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad68ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380323.967168:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000035753407 reply state 00000000aa0e8742 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad68ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.967181:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad68ef5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380323.967187:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d6fc4767000) 00010000:00010000:2.0:1787380323.967189:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787380323.967192:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787380323.967272:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+11:10487:x1874203848497024:12345-192.168.206.30@tcp:36:touch.500 Request processed in 410us (596us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787380323.967279:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 31 00000100:00100000:0.0:1787380323.970192:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380323.970262:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848497152 00000100:00100000:1.0:1787380323.970271:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848497152 00000100:00100000:1.0:1787380323.970322:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 32 00000100:00100000:1.0:1787380323.970331:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+11:10487:x1874203848497152:12345-192.168.206.30@tcp:101:touch.500 00010000:00010000:1.0:1787380323.970350:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380323.970367:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9aa00/0xcf3c46fdcad68efc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0abfb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.970416:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9aa00/0xcf3c46fdcad68efc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abfb expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.970428:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9aa00/0xcf3c46fdcad68efc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abfb expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380323.970461:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d6fc4767000) 00010000:00010000:1.0:1787380323.970464:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787380323.970467:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9aa00, rc 0) 00000100:00100000:1.0:1787380323.970518:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+12:10487:x1874203848497152:12345-192.168.206.30@tcp:101:touch.500 Request processed in 189us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380323.970525:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 32 00000100:00100000:3.0:1787380323.975005:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380323.975104:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848497280 00000100:00100000:1.0:1787380323.975114:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848497280 00000100:00100000:1.0:1787380323.975165:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:1.0:1787380323.975173:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2396:x1874203848497280:12345-192.168.206.30@tcp:8:touch.500 00010000:00080000:1.0:1787380323.975206:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp t0 exp 0000000000000000 cur 334 last 0 00000020:00000080:1.0:1787380323.975234:0:8435:0:(genops.c:1406:class_connect()) connect: client 7da54272-8859-4cb3-ba98-d1d4e18c7c38, cookie 0xcf3c46fdcad68f03 00002000:00100000:1.0:1787380323.975246:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7da54272-8859-4cb3-ba98-d1d4e18c7c38/ffff9d6fff5fc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787380323.975261:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787380323.975328:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787380323.975355:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9d6fff5fa800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380323.975419:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2396:x1874203848497280:12345-192.168.206.30@tcp:8:touch.500 Request processed in 245us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380323.975426:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:0.0:1787380323.979066:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380323.979157:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848497408 00000100:00100000:2.0:1787380323.979167:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848497408 00000100:00100000:2.0:1787380323.979240:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:2.0:1787380323.979250:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:0:x1874203848497408:12345-192.168.206.30@tcp:2:touch.500 00000100:00080000:0.0:1787380323.979420:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787380323.985480:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1787380323.985496:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000100:00100000:2.0:1787380323.985672:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:0:x1874203848497408:12345-192.168.206.30@tcp:2:touch.500 Request processed in 6420us (6610us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787380323.985693:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:3.0:1787380323.996415:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380323.996927:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848497664 00000100:00100000:0.0:1787380323.996937:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848497664 00000100:00100000:0.0:1787380323.996991:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:0.0:1787380323.997000:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+12:10487:x1874203848497664:12345-192.168.206.30@tcp:35:touch.500 00000100:00100000:0.0:1787380323.997277:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+13:10487:x1874203848497664:12345-192.168.206.30@tcp:35:touch.500 Request processed in 276us (869us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787380323.997285:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:3.0:1787380324.015322:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380324.015485:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848497792 00000100:00100000:2.0:1787380324.015494:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848497792 00000100:00100000:2.0:1787380324.015553:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:2.0:1787380324.015563:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+13:10488:x1874203848497792:12345-192.168.206.30@tcp:101:rm.0 00010000:00010000:2.0:1787380324.015584:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380324.015602:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68f0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac02 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.015661:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad68f11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.015675:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad68f11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.015685:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad68f11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380324.015726:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787380324.015729:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787380324.015761:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad68f11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.015784:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68f0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac02 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.015801:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad68f11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac02 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.015882:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d6fc4e52d00) 00010000:00010000:2.0:1787380324.015885:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787380324.015888:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46c00, rc 0) 00000100:00100000:2.0:1787380324.015950:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+14:10488:x1874203848497792:12345-192.168.206.30@tcp:101:rm.0 Request processed in 387us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380324.015957:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:3.0:1787380324.031253:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380324.031353:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848498048 00000100:00100000:1.0:1787380324.031361:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848498048 00000100:00100000:1.0:1787380324.031423:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00100000:1.0:1787380324.031433:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+14:10488:x1874203848498048:12345-192.168.206.30@tcp:101:rm.0 00010000:00010000:1.0:1787380324.031451:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380324.031482:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9a800/0xcf3c46fdcad68f18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac09 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380324.031571:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787380324.031703:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9a800/0xcf3c46fdcad68f18 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac09 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380324.031717:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25a8e00) 00010000:00010000:1.0:1787380324.031720:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787380324.031725:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9a800/0xcf3c46fdcad68f18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac09 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380324.031737:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9a800, rc 0) 00000100:00100000:1.0:1787380324.031799:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+15:10488:x1874203848498048:12345-192.168.206.30@tcp:101:rm.0 Request processed in 368us (555us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1787380324.031842:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00100000:1.0:1787380324.039287:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380324.039369:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848498176 00000100:00100000:3.0:1787380324.039379:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848498176 00000100:00100000:3.0:1787380324.039441:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:3.0:1787380324.039460:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+15:10488:x1874203848498176:12345-192.168.206.30@tcp:37:rm.0 00000100:00100000:0.0:1787380324.049258:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+15:10488:x1874203848498176:12345-192.168.206.30@tcp:37:rm.0 Request processed in 9798us (9968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380324.049272:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:3.0:1787380324.052360:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380324.052509:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848498432 00000100:00100000:0.0:1787380324.052571:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848498432 00000100:00100000:0.0:1787380324.052676:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:0.0:1787380324.052687:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7be5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+15:10488:x1874203848498432:12345-192.168.206.30@tcp:35:rm.0 00000100:00100000:0.0:1787380324.052927:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7be5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+16:10488:x1874203848498432:12345-192.168.206.30@tcp:35:rm.0 Request processed in 242us (574us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787380324.052935:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:1.0:1787380324.055399:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380324.055551:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848498688 00000100:00100000:2.0:1787380324.055560:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848498688 00000100:00100000:2.0:1787380324.055621:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 35 00000100:00100000:2.0:1787380324.055632:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+16:10488:x1874203848498688:12345-192.168.206.30@tcp:101:rm.0 00010000:00010000:2.0:1787380324.055654:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380324.055675:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68f26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac10 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.055771:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68f2d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.055786:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68f2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.055796:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68f2d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380324.055938:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787380324.056036:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68f26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac10 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.056074:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68f2d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac10 expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.056083:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d6fc4e52d00) 00010000:00010000:2.0:1787380324.056085:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787380324.056088:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46600, rc 0) 00000100:00100000:2.0:1787380324.056250:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:10488:x1874203848498688:12345-192.168.206.30@tcp:101:rm.0 Request processed in 619us (858us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787380324.056257:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 35 00000100:00100000:3.0:1787380324.058760:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380324.058885:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848498816 00000100:00100000:1.0:1787380324.058894:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848498816 00000100:00100000:1.0:1787380324.058949:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 36 00000100:00100000:1.0:1787380324.058959:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:10488:x1874203848498816:12345-192.168.206.30@tcp:41:rm.0 00000004:00000024:1.0:1787380324.059010:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1787380324.059074:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:10488:x1874203848498816:12345-192.168.206.30@tcp:41:rm.0 Request processed in 117us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380324.059082:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 36 00000100:00100000:2.0:1787380324.061362:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380324.061508:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848498944 00000100:00100000:0.0:1787380324.061567:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848498944 00000100:00100000:0.0:1787380324.061646:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 37 00000100:00100000:0.0:1787380324.061654:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec369b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:10488:x1874203848498944:12345-192.168.206.30@tcp:101:rm.0 00010000:00010000:0.0:1787380324.061672:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380324.061688:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad68f3b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac17 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.061755:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad68f42 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.061768:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad68f42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.061778:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad68f42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.061789:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68f49 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.061795:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68f49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.061802:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68f49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.061917:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad68f50 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.061926:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad68f50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.061941:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad68f50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380324.061973:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787380324.061977:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787380324.061993:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad68f50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.062014:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad68f50 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.062021:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad68f42 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.062028:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad68f42 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.062034:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad68f42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.062039:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380324.062043:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad68f42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.062049:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad68f42 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.062060:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d6fc4e52d00) 00010000:00010000:0.0:1787380324.062063:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380324.062067:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad68f42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.062074:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad68f42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.062086:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68f49 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.062092:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68f49 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.062103:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68f49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.062108:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380324.062111:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68f49 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.062118:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68f49 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.062137:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xdc94a951 (ffff9d6ec241bd00) 00010000:00010000:0.0:1787380324.062140:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380324.062143:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68f49 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.062148:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad68f49 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.062172:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad68f3b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac17 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.062183:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad68f50 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac17 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.062190:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d6fc4767000) 00010000:00010000:0.0:1787380324.062193:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380324.062195:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867c00, rc 0) 00000100:00100000:0.0:1787380324.062250:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec369b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:10488:x1874203848498944:12345-192.168.206.30@tcp:101:rm.0 Request processed in 596us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380324.062266:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 37 00000100:00100000:3.0:1787380324.064706:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380324.065224:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848499200 00000100:00100000:2.0:1787380324.065233:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848499200 00000100:00100000:2.0:1787380324.065283:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 38 00000100:00100000:2.0:1787380324.065291:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec310bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:10488:x1874203848499200:12345-192.168.206.30@tcp:36:rm.0 00010000:00010000:2.0:1787380324.065353:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787380324.065374:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad68f50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac17 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.065394:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9aa00/0xcf3c46fdcad68efc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abfb expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.065405:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d6fc4767000) 00010000:00010000:2.0:1787380324.065423:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad68f11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac02 expref: 17 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.065442:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d6fc4e52d00) 00010000:00010000:2.0:1787380324.065446:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380324.065471:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68f57 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.065482:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68f57 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.065491:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68f57 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.065500:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad68f5e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.065507:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad68f5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.065660:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad68f5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.065743:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad68f65 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.065752:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad68f65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.065758:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad68f65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787380324.066072:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787380324.066083:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 334390272875ns, next at 335390271050ns, rc = 0 00010000:00010000:2.0:1787380324.066145:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68f6c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066155:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68f6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066163:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68f6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066170:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68f6c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066177:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68f6c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066183:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68f6c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066200:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787380324.066220:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380324.066225:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68f6c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066232:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47600 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380324.066236:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68f6c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066243:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68f6c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066253:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d6fc4767000) 00010000:00010000:2.0:1787380324.066256:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787380324.066266:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68f6c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066272:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad68f6c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066282:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380324.066284:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380324.066285:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380324.066297:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad68f65 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066303:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad68f65 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066309:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad68f65 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066314:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47e00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380324.066318:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad68f65 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066324:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad68f65 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066331:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d6fc4767000) 00010000:00010000:2.0:1787380324.066333:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787380324.066336:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad68f65 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066342:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad68f65 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066355:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68f57 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066366:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68f57 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066372:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68f57 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066377:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47c00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380324.066380:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68f57 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066385:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68f57 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066392:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d6fc4e52d00) 00010000:00010000:2.0:1787380324.066394:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380324.066396:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68f57 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066402:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad68f57 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380324.066674:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004270d5ab reply state 0000000098e5ef8a transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad68f5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066690:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad68f5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380324.066697:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xdc94a951 (ffff9d6ec241bd00) 00010000:00010000:2.0:1787380324.066699:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787380324.066702:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787380324.066779:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec310bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:10488:x1874203848499200:12345-192.168.206.30@tcp:36:rm.0 Request processed in 1487us (2077us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787380324.066795:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 38 00000100:00100000:3.0:1787380324.069921:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380324.070038:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848499456 00000100:00100000:2.0:1787380324.070048:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848499456 00000100:00100000:2.0:1787380324.070093:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:2.0:1787380324.070103:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:10488:x1874203848499456:12345-192.168.206.30@tcp:35:rm.0 00000100:00100000:2.0:1787380324.070319:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:10488:x1874203848499456:12345-192.168.206.30@tcp:35:rm.0 Request processed in 216us (405us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787380324.070327:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:3.0:1787380324.072679:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380324.072783:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848499712 00000100:00100000:0.0:1787380324.072792:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848499712 00000100:00100000:0.0:1787380324.072873:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 39 00000100:00100000:0.0:1787380324.072892:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:10488:x1874203848499712:12345-192.168.206.30@tcp:36:rm.0 00010000:00010000:0.0:1787380324.072963:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787380324.072987:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46600/0xcf3c46fdcad68f2d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac10 expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073007:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe0a9be00/0xcf3c46fdcad68ecb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abed expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073019:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d6fc4e52d00) 00010000:00010000:0.0:1787380324.073033:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47a00/0xcf3c46fdcad68e8c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abdf expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073042:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25a8e00) 00010000:00010000:0.0:1787380324.073048:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380324.073069:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866000/0xcf3c46fdcad68f73 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073081:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866000/0xcf3c46fdcad68f73 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073090:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866000/0xcf3c46fdcad68f73 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073101:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68f7a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073115:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68f7a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073133:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68f7a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073206:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68f81 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073214:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68f81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073220:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68f81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380324.073413:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787380324.073428:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68f81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073434:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68f81 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073439:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68f81 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073444:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380324.073447:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68f81 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073454:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68f81 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073473:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9d6ec26f4f00) 00010000:00010000:0.0:1787380324.073476:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787380324.073479:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68f81 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073485:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad68f81 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073501:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866000/0xcf3c46fdcad68f73 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073507:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866000/0xcf3c46fdcad68f73 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073512:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866000/0xcf3c46fdcad68f73 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073517:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380324.073519:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866000/0xcf3c46fdcad68f73 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073525:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866000/0xcf3c46fdcad68f73 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073531:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec26f4800) 00010000:00010000:0.0:1787380324.073533:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380324.073536:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866000/0xcf3c46fdcad68f73 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073540:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866000/0xcf3c46fdcad68f73 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787380324.073561:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000098f035c2 reply state 00000000da46f42d transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68f7a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073572:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68f7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380324.073579:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380324.073581:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787380324.073584:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787380324.073643:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:10488:x1874203848499712:12345-192.168.206.30@tcp:36:rm.0 Request processed in 752us (970us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787380324.073650:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 39 00010000:00010000:1.0:1787380324.429582:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380325.452004:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380326.028050:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380326.028071:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867453440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380326.028148:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380326.028207:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867453440 00000100:00100000:2.0:1787380326.028214:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867453440 00000100:00100000:2.0:1787380326.028255:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787380326.028265:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec369a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867453440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787380326.028297:0:13003:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787380326.028340:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec369a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867453440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380326.028347:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787380326.028391:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867453440:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380326.028476:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380326.028484:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867453568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787380326.028522:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380326.028550:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867453568 00000100:00100000:3.0:1787380326.028553:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867453568 00000100:00100000:3.0:1787380326.028582:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787380326.028588:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec335aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867453568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787380326.028605:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380326.028642:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec335aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867453568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380326.028648:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1787380326.028668:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787380326.028689:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3108380 x1874203867453568/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380326.028702:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867453568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787380326.029383:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec335b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867453824:0@lo:400:kworker.0 00000100:00100000:3.0:1787380326.029417:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380326.029437:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867454336:0@lo:400:kworker.0 00000100:00100000:3.0:1787380326.029456:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380326.029470:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867454848:0@lo:400:kworker.0 00000100:00100000:3.0:1787380326.029487:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380326.029583:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec335b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867454080:0@lo:400:kworker.0 00000100:00100000:1.0:1787380326.029612:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380326.029643:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec335a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867454592:0@lo:400:kworker.0 00000100:00100000:1.0:1787380326.029663:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380326.029682:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787380326.029688:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec335ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867453696:0@lo:400:kworker.0 00000100:00100000:1.0:1787380326.029711:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380326.029732:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867454208:0@lo:400:kworker.0 00000100:00100000:1.0:1787380326.029753:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380326.029767:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867454720:0@lo:400:kworker.0 00000100:00100000:1.0:1787380326.029786:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380326.029804:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867453952:0@lo:400:kworker.0 00000100:00100000:1.0:1787380326.029859:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380326.029942:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867454464:0@lo:400:kworker.0 00000100:00100000:1.0:1787380326.029966:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380326.029983:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867454976:0@lo:400:kworker.0 00000100:00100000:1.0:1787380326.030003:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380326.030034:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867454080 00000100:00100000:1.0:1787380326.030039:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867454080 00000100:00100000:1.0:1787380326.030072:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787380326.030080:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867454080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380326.030132:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867454080:12345-0@lo:400:kworker.0 Request processed in 53us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380326.030139:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787380326.030169:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867454592 00000100:00100000:1.0:1787380326.030172:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867454592 00000100:00100000:1.0:1787380326.030195:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867454464 00000100:00100000:1.0:1787380326.030197:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867454464 00000100:00100000:1.0:1787380326.030210:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867454976 00000100:00100000:1.0:1787380326.030212:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867454976 00000100:00100000:1.0:1787380326.030223:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787380326.030227:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867454592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380326.030254:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867454592:12345-0@lo:400:kworker.0 Request processed in 26us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380326.030259:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787380326.030267:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787380326.030272:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867454464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380326.030293:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867454464:12345-0@lo:400:kworker.0 Request processed in 21us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380326.030298:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787380326.030306:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787380326.030311:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867454976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380326.030329:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867454976:12345-0@lo:400:kworker.0 Request processed in 18us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380326.030333:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787380326.030345:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867453696 00000100:00100000:1.0:1787380326.030347:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867453696 00000100:00100000:1.0:1787380326.030366:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787380326.030370:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867453696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380326.030391:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867453696:12345-0@lo:400:kworker.0 Request processed in 20us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380326.030404:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1787380326.030425:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867453824 00000100:00100000:1.0:1787380326.030428:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867453824 00000100:00100000:1.0:1787380326.030442:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867454336 00000100:00100000:1.0:1787380326.030444:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867454336 00000100:00100000:1.0:1787380326.030452:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867454848 00000100:00100000:1.0:1787380326.030454:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867454848 00000100:00100000:1.0:1787380326.030462:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867454208 00000100:00100000:1.0:1787380326.030464:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867454208 00000100:00100000:1.0:1787380326.030472:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867454720 00000100:00100000:1.0:1787380326.030474:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867454720 00000100:00100000:1.0:1787380326.030482:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867453952 00000100:00100000:1.0:1787380326.030484:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867453952 00000100:00100000:1.0:1787380326.030492:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787380326.030497:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867453824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380326.030598:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787380326.030606:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867454336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380326.030638:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867454336:12345-0@lo:400:kworker.0 Request processed in 34us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380326.030649:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787380326.030660:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787380326.030665:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867454848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380326.030689:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867454848:12345-0@lo:400:kworker.0 Request processed in 24us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380326.030694:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787380326.030702:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787380326.030707:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867454208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380326.030725:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867454208:12345-0@lo:400:kworker.0 Request processed in 18us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380326.030730:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787380326.030737:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787380326.030741:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867454720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380326.030757:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867454720:12345-0@lo:400:kworker.0 Request processed in 16us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380326.030762:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1787380326.030770:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787380326.030774:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867453952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380326.030791:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867453952:12345-0@lo:400:kworker.0 Request processed in 17us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380326.030796:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00080000:3.0:1787380326.030825:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787380326.030828:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787380326.030831:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787380326.030833:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787380326.031479:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3359880 x1874203867454336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380326.031498:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867454336:0@lo:400:kworker.0 00010000:00080000:3.0:1787380326.031587:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3358000 x1874203867454848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380326.031596:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867454848:0@lo:400:kworker.0 00000100:00100000:2.0:1787380326.031902:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec335ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867453696:0@lo:400:kworker.0 00000100:00100000:2.0:1787380326.031916:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867454208:0@lo:400:kworker.0 00000100:00100000:2.0:1787380326.031926:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867454720:0@lo:400:kworker.0 00000100:00100000:2.0:1787380326.031955:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec335b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867454080:0@lo:400:kworker.0 00010000:00080000:2.0:1787380326.031967:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec335a680 x1874203867454592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380326.031975:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec335a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867454592:0@lo:400:kworker.0 00000100:00100000:1.0:1787380326.032767:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867453824:12345-0@lo:400:kworker.0 Request processed in 2265us (3346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380326.032777:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787380326.032853:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867453952:0@lo:400:kworker.0 00000100:00100000:3.0:1787380326.033058:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec335b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867453824:0@lo:400:kworker.0 00000100:00100000:0.0:1787380326.033211:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380326.033224:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867455104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380326.033262:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380326.033333:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867455104 00000100:00100000:2.0:1787380326.033339:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867455104 00000100:00100000:2.0:1787380326.033379:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787380326.033387:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867455104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787380326.033404:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380326.033443:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2604700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867455104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380326.033449:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1787380326.033601:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec369aa00 x1874203867455104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380326.033615:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867455104:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787380326.033660:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3359500 x1874203867454464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380326.033669:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867454464:0@lo:400:kworker.0 00010000:00080000:1.0:1787380326.033682:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3108380 x1874203867454976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380326.033689:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867454976:0@lo:400:kworker.0 00010000:00010000:0.0:1787380326.476206:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787380326.540747:0:8869:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336864935511ns, next at 337864933236ns, rc = 0 00000100:00100000:1.0:1787380326.540784:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867455232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380326.540875:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380326.544282:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867455232 00000100:00100000:2.0:1787380326.544292:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867455232 00000100:00100000:2.0:1787380326.544347:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787380326.544356:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867455232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380326.544383:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380326.544447:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380326.544472:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867455360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787380326.544476:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867455232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (3613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380326.544482:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1787380326.544528:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3108380 x1874203867455232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380326.544547:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867455232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380326.547261:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380326.548724:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867455360 00000100:00100000:2.0:1787380326.548742:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867455360 00000100:00100000:2.0:1787380326.548796:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787380326.548804:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867455360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787380326.548843:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380326.548924:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867455360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (1669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380326.548930:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:1.0:1787380326.549014:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3698e00 x1874203867455360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380326.549033:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867455360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380326.562595:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380326.562635:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380326.562655:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380326.562672:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380326.562699:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380326.562721:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380326.562744:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848500096 00000100:00100000:3.0:1787380326.562754:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848500096 00000100:00100000:3.0:1787380326.562800:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848500352 00000100:00100000:3.0:1787380326.562803:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848500352 00000100:00100000:3.0:1787380326.562845:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848499968 00000100:00100000:3.0:1787380326.562848:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848499968 00000100:00100000:3.0:1787380326.562859:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848500480 00000100:00100000:3.0:1787380326.562861:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848500480 00000100:00100000:3.0:1787380326.562990:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 207 00000100:00100000:3.0:1787380326.562998:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848500096:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380326.563062:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848500096:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 64us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380326.563069:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 207 00000100:00100000:3.0:1787380326.563103:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 208 00000100:00100000:3.0:1787380326.563119:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2399:x1874203848500352:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380326.563147:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2399:x1874203848500352:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 39us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380326.563154:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 208 00000100:00100000:3.0:1787380326.563166:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 209 00000100:00100000:3.0:1787380326.563172:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:2399:x1874203848499968:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380326.563197:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:2399:x1874203848499968:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 26us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380326.563203:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 209 00000100:00100000:3.0:1787380326.563215:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 210 00000100:00100000:3.0:1787380326.563221:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2399:x1874203848500480:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380326.563242:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2399:x1874203848500480:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 22us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380326.563248:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 210 00000100:00100000:3.0:1787380326.563270:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848500224 00000100:00100000:3.0:1787380326.563273:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848500224 00000100:00100000:3.0:1787380326.563300:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 78 00000100:00100000:3.0:1787380326.563306:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848500224:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380326.563329:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848500224:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 24us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380326.563336:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 78 00000100:00080000:3.0:1787380326.563355:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787380326.563359:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787380326.563366:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787380326.563627:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848499840 00000100:00100000:2.0:1787380326.563631:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848499840 00000100:00100000:2.0:1787380326.563661:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 335 00000100:00100000:2.0:1787380326.563668:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2399:x1874203848499840:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380326.563695:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2399:x1874203848499840:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 28us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380326.563700:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 335 00010000:00010000:1.0:1787380327.500342:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380327.564174:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867455488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787380327.564239:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380327.564601:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867455488 00000100:00100000:0.0:1787380327.564609:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867455488 00000100:00100000:0.0:1787380327.564659:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787380327.564670:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec369ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867455488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787380327.564706:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787380327.564764:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec369ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867455488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380327.564784:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787380327.565301:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867455488:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1787380327.997087:0:13682:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1787380328.524829:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787380329.067345:0:13731:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd749963c0 00000020:00000080:0.0:1787380329.067361:0:13731:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787380329.067366:0:13731:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787380329.067374:0:13731:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd74998650 20000000:00000080:0.0:1787380329.067381:0:13731:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d6ec3625c00 uarg=0000000000000000 20000000:01000000:0.0:1787380329.067424:0:13731:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787380329.067498:0:13731:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787380329.067504:0:13731:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787380329.068226:0:13732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787380329.068389:0:13731:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787380329.075355:0:13731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787380329.075410:0:13731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787380329.075580:0:13731:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787380329.075610:0:13731:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787380329.075628:0:13731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fe7866a00/0xcf3c46fdcad68f88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.075645:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68e15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abca expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.075652:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe7867800/0xcf3c46fdcad68e1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abd1 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.075659:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68e2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68e23 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.075665:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ff5fda600/0xcf3c46fdcad68e38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68e31 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.075687:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fc165ba00/0xcf3c46fdcad68e46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68e3f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.075693:0:13731:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68e54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68e4d expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.075700:0:13731:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6fe7866a00/0xcf3c46fdcad68f88 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.075734:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68e54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68e4d expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.075746:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68e54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68e4d expref: 23 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380329.075760:0:13731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1874203867455616:0@lo:104: 00000100:00100000:0.0:1787380329.076532:0:13731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787380329.076843:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc165ba00/0xcf3c46fdcad68e46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68e3f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.076859:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc165ba00/0xcf3c46fdcad68e46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68e3f expref: 23 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380329.076870:0:13731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43ead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1874203867455744:0@lo:104: 00010000:00010000:0.0:1787380329.076903:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ff5fda600/0xcf3c46fdcad68e38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68e31 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.076910:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6ff5fda600/0xcf3c46fdcad68e38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68e31 expref: 23 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380329.076930:0:13731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43ea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1874203867455872:0@lo:104: 00010000:00010000:0.0:1787380329.076955:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68e2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad68e23 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.076964:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68e2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad68e23 expref: 23 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380329.076972:0:13731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1874203867456000:0@lo:104: 00010000:00010000:0.0:1787380329.076999:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe7867800/0xcf3c46fdcad68e1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abd1 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.077010:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6fe7867800/0xcf3c46fdcad68e1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abd1 expref: 12 pid: 6513 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380329.077019:0:13731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1874203867456128:192.168.206.30@tcp:104: 00010000:00010000:0.0:1787380329.077075:0:13731:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68e15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abca expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.077083:0:13731:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68e15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abca expref: 12 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380329.077091:0:13731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1874203867456256:192.168.206.30@tcp:104: 00000100:00100000:0.0:1787380329.077128:0:13731:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc821bf00 going to sleep for 11 seconds 00000004:00080000:2.0:1787380329.081132:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787380329.081175:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1787380329.081186:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787380329.081325:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380329.081344:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867456384:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787380329.081403:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380329.081578:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867456384 00000100:00100000:3.0:1787380329.081586:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867456384 00000100:00100000:3.0:1787380329.081637:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787380329.081646:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867456384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787380329.081673:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1787380329.081703:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a894264, atime: 0x6a894264, ctime: 0x6a894264, blocks: 0x0 00010000:00010000:3.0:1787380329.081711:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a9050a8/0xcf3c46fdcad68f8f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.081726:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=339s v=(0 0) 00010000:00010000:3.0:1787380329.081731:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380329.081736:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a9050a8/0xcf3c46fdcad68f8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.081752:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a9050a8/0xcf3c46fdcad68f8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.081761:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a9050a8/0xcf3c46fdcad68f8f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.081769:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a9050a8/0xcf3c46fdcad68f8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.081800:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787380329.081946:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3642:x1874203867456384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 301us (541us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787380329.081953:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1787380329.081978:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787380329.081989:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380329.081994:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a9050a8/0xcf3c46fdcad68f8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.082002:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdaa00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:3.0:1787380329.082007:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a9050a8/0xcf3c46fdcad68f8f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.082017:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a9050a8/0xcf3c46fdcad68f8f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.082032:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a9050a8/0xcf3c46fdcad68f8f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.082039:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a9050a8/0xcf3c46fdcad68f8f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.082054:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380329.082056:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380329.082057:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787380329.082085:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6ec336e300/2, rc 0, transno 4294967301 00000100:00100000:3.0:1787380329.082107:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867456384:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787380329.082175:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad68ee0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082183:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad68ee0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082195:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad68ee0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082200:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fda000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380329.082204:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad68ee0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082210:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad68ee0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082221:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xdc94a951 (ffff9d6ec241bd00) 00010000:00010000:0.0:1787380329.082224:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380329.082227:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad68ee0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082233:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad68ee0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082278:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad68ef5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082284:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad68ef5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082290:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad68ef5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082295:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380329.082298:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad68ef5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082315:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad68ef5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082324:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9d6fc4767000) 00010000:00010000:0.0:1787380329.082326:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380329.082329:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad68ef5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082335:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad68ef5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082351:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad68f5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082357:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad68f5e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082362:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad68f5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082367:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380329.082370:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad68f5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082376:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad68f5e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082383:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xdc94a951 (ffff9d6ec241bd00) 00010000:00010000:0.0:1787380329.082386:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380329.082389:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad68f5e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082401:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad68f5e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xdc94a951 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082417:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68f7a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082424:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68f7a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082539:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68f7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082544:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380329.082547:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68f7a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082553:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68f7a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082562:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380329.082564:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380329.082567:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68f7a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.082573:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad68f7a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380329.082697:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787380329.082719:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380329.082826:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380329.082968:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380329.083128:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867455616 00000100:00100000:2.0:1787380329.083135:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867455616 00000100:00100000:2.0:1787380329.083162:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867455744 00000100:00100000:2.0:1787380329.083165:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867455744 00000100:00100000:2.0:1787380329.083176:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867455872 00000100:00100000:2.0:1787380329.083178:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867455872 00000100:00100000:2.0:1787380329.083188:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787380329.083194:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:13731:x1874203867455616:12345-0@lo:104: 00010000:00010000:2.0:1787380329.083206:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68e4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68e54 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.083279:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787380329.083286:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+5:13731:x1874203867455616:12345-0@lo:104: Request processed in 91us (6756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380329.083293:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787380329.083326:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787380329.083331:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:13731:x1874203867455744:12345-0@lo:104: 00010000:00010000:2.0:1787380329.083338:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbe00/0xcf3c46fdcad68e3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68e46 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.083369:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787380329.083374:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+4:13731:x1874203867455744:12345-0@lo:104: Request processed in 43us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380329.083380:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787380329.083391:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787380329.083397:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:13731:x1874203867455872:12345-0@lo:104: 00010000:00010000:2.0:1787380329.083404:0:6504:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867600/0xcf3c46fdcad68e31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68e38 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.083446:0:6504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787380329.083451:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:13731:x1874203867455872:12345-0@lo:104: Request processed in 55us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380329.083457:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:2.0:1787380329.083472:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787380329.083477:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68e4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68e54 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.083493:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165b000 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:2.0:1787380329.083497:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68e4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68e54 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.083505:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68e4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68e54 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380329.083511:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68e4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68e54 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380329.083516:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787380329.083544:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68e4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68e54 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.083550:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787380329.083565:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68e4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68e54 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.083572:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b000/0xcf3c46fdcad68e4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68e54 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.083582:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787380329.083585:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbe00/0xcf3c46fdcad68e3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68e46 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.083591:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdbe00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:2.0:1787380329.083593:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbe00/0xcf3c46fdcad68e3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68e46 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.083610:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbe00/0xcf3c46fdcad68e3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68e46 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380329.083616:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbe00/0xcf3c46fdcad68e3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68e46 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380329.083621:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787380329.083634:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbe00/0xcf3c46fdcad68e3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68e46 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.083639:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787380329.083650:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbe00/0xcf3c46fdcad68e3f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68e46 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.083656:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbe00/0xcf3c46fdcad68e3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68e46 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.083664:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380329.083667:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867600/0xcf3c46fdcad68e31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68e38 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.083671:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867600 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:2.0:1787380329.083674:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867600/0xcf3c46fdcad68e31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68e38 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.083680:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867600/0xcf3c46fdcad68e31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68e38 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380329.083686:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867600/0xcf3c46fdcad68e31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68e38 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380329.083697:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787380329.083712:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867600/0xcf3c46fdcad68e31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68e38 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.083717:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787380329.083722:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867600/0xcf3c46fdcad68e31 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68e38 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.083728:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867600/0xcf3c46fdcad68e31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68e38 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.083737:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380329.083738:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380329.083740:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380329.083746:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380329.083757:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787380329.083769:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867456512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787380329.083801:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380329.084037:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867456640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380329.084063:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380329.084117:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380329.084125:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867456768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380329.084146:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787380329.084172:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380329.084200:0:13731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1874203867455616:0@lo:104: 00000100:00100000:3.0:1787380329.084209:0:13731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43ead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1874203867455744:0@lo:104: 00000100:00100000:3.0:1787380329.084216:0:13731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43ea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1874203867455872:0@lo:104: 00000100:00100000:2.0:1787380329.084263:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867456512 00000100:00100000:2.0:1787380329.084268:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867456512 00010000:00010000:2.0:1787380329.084290:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68e54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68e4d expref: 24 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380329.084316:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867456640 00000100:00100000:2.0:1787380329.084319:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867456640 00010000:00010000:2.0:1787380329.084330:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc165ba00/0xcf3c46fdcad68e46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68e3f expref: 25 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380329.084340:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867456768 00000100:00100000:2.0:1787380329.084342:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867456768 00010000:00010000:2.0:1787380329.084363:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ff5fda600/0xcf3c46fdcad68e38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68e31 expref: 26 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380329.084376:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787380329.084383:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3698e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+26:3641:x1874203867456512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787380329.084393:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380329.084397:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68e54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68e4d expref: 26 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.084408:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68e54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68e4d expref: 26 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380329.084500:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787380329.084508:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+26:3639:x1874203867456640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787380329.084516:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380329.084521:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc165ba00/0xcf3c46fdcad68e46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68e3f expref: 26 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.084530:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc165ba00/0xcf3c46fdcad68e46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68e3f expref: 26 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.084541:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc165ba00/0xcf3c46fdcad68e46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68e3f expref: 26 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.084553:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380329.084584:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+25:3639:x1874203867456640:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380329.084590:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787380329.084604:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787380329.084617:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867456768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787380329.084625:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380329.084630:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ff5fda600/0xcf3c46fdcad68e38 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68e31 expref: 24 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.084638:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ff5fda600/0xcf3c46fdcad68e38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68e31 expref: 24 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.084649:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5fda600/0xcf3c46fdcad68e38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68e31 expref: 24 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.084657:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380329.084677:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:3639:x1874203867456768:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380329.084683:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787380329.084707:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867456768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380329.084714:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867456640:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787380329.084752:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68e54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68e4d expref: 26 pid: 6516 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.084763:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380329.084798:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3698e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:3641:x1874203867456512:12345-0@lo:103:ldlm_bl.0 Request processed in 415us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380329.084804:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787380329.084894:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867456512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380329.085183:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380329.085216:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380329.085232:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848500608 00000100:00100000:3.0:1787380329.085237:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848500608 00010000:00010000:3.0:1787380329.085255:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68e15 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abca expref: 13 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380329.085268:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848500736 00000100:00100000:3.0:1787380329.085270:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848500736 00010000:00010000:3.0:1787380329.085280:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe7867800/0xcf3c46fdcad68e1c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abd1 expref: 14 pid: 6513 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380329.085302:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 49 00000100:00100000:3.0:1787380329.085308:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3359500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2facc94b-d95a-46d6-aa1a-c4299279749f+14:2399:x1874203848500608:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380329.085317:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380329.085321:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68e15 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abca expref: 14 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.085329:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68e15 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abca expref: 14 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.085340:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380329.085376:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3359500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2facc94b-d95a-46d6-aa1a-c4299279749f+14:2399:x1874203848500608:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 68us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380329.085383:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 49 00000100:00100000:3.0:1787380329.085404:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 50 00000100:00100000:3.0:1787380329.085410:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3358a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2399:x1874203848500736:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380329.085418:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380329.085422:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe7867800/0xcf3c46fdcad68e1c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abd1 expref: 13 pid: 6513 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.085442:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe7867800/0xcf3c46fdcad68e1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abd1 expref: 13 pid: 6513 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.085450:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380329.085468:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3358a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2399:x1874203848500736:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 58us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380329.085474:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 50 00010000:00010000:2.0:1787380329.086084:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7867800/0xcf3c46fdcad68e1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abd1 expref: 12 pid: 6513 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380329.086107:0:13731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1874203867456128:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380329.086119:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc165ac00/0xcf3c46fdcad68e15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0abca expref: 11 pid: 6516 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380329.086128:0:13731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1874203867456256:192.168.206.30@tcp:104: 00000100:00100000:1.0:1787380329.086476:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867456000 00000100:00100000:1.0:1787380329.086482:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867456000 00000100:00100000:1.0:1787380329.086512:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787380329.086520:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:13731:x1874203867456000:12345-0@lo:104: 00010000:00010000:1.0:1787380329.086530:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad68e23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68e2a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380329.086592:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787380329.086598:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1e31f5e-7395-4c34-a795-7159073dc2a2+3:13731:x1874203867456000:12345-0@lo:104: Request processed in 80us (3630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380329.086604:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1787380329.086628:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380329.086634:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad68e23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad68e2a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380329.086652:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867200 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:1.0:1787380329.086656:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad68e23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad68e2a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380329.086663:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad68e23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad68e2a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380329.086669:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad68e23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad68e2a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380329.086675:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787380329.086703:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad68e23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68e2a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380329.086709:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380329.086723:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad68e23 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68e2a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380329.086729:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad68e23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad68e2a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380329.086743:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380329.086744:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380329.086746:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380329.086874:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867456896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380329.086909:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380329.086950:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867456896 00000100:00100000:3.0:1787380329.086954:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867456896 00010000:00010000:3.0:1787380329.086970:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68e2a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68e23 expref: 21 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380329.086989:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787380329.086995:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec335b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:3641:x1874203867456896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787380329.087004:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380329.087008:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68e2a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad68e23 expref: 21 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.087017:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68e2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad68e23 expref: 21 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.087030:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6fe7866a00/0xcf3c46fdcad68f88 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.087038:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7866a00/0xcf3c46fdcad68f88 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.087052:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fe7866a00/0xcf3c46fdcad68f88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.087059:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fe7866a00/0xcf3c46fdcad68f88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.087066:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fe7866a00/0xcf3c46fdcad68f88 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.087082:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fe7866a00/0xcf3c46fdcad68f88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.087087:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866a00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:3.0:1787380329.087090:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fe7866a00/0xcf3c46fdcad68f88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.087109:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fe7866a00/0xcf3c46fdcad68f88 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.087118:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fe7866a00/0xcf3c46fdcad68f88 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.087127:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380329.087154:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec335b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:3641:x1874203867456896:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380329.087161:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787380329.087196:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867456896:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787380329.087225:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc165be00/0xcf3c46fdcad68e2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad68e23 expref: 20 pid: 6513 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380329.087234:0:13731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13731:1874203867456000:0@lo:104: 00010000:00010000:3.0:1787380329.087254:0:13731:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6fe7866a00/0xcf3c46fdcad68f88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.087262:0:13731:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6fe7866a00/0xcf3c46fdcad68f88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.087267:0:13731:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fe7866a00/0xcf3c46fdcad68f88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380329.087280:0:13731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7866a00/0xcf3c46fdcad68f88 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380329.551126:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787380329.898611:0:13782:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffc3be3f1a0 00000020:00000080:2.0:1787380329.898629:0:13782:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787380329.898634:0:13782:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787380329.898641:0:13782:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc3be41430 20000000:00000080:2.0:1787380329.898647:0:13782:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d6ec36ec800 uarg=0000000000000000 20000000:01000000:2.0:1787380329.898687:0:13782:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1787380329.898693:0:13782:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1787380329.898697:0:13782:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1787380329.899749:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1787380329.900695:0:13782:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1787380329.900973:0:13782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1787380329.901005:0:13782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1787380329.901021:0:13782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1787380329.901033:0:13782:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787380329.901061:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68f96 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.901076:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68f96 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.901086:0:13782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68f96 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.901102:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68f96 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.901109:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68f96 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.901116:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68f96 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.901122:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866200 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380329.901126:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68f96 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.901133:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68f96 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.901144:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68f96 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.901151:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68f96 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380329.901157:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7866200/0xcf3c46fdcad68f96 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380330.337036:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380330.337192:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848500864 00000100:00100000:1.0:1787380330.337202:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848500864 00000100:00100000:1.0:1787380330.337255:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 336 00000100:00100000:1.0:1787380330.337264:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+11:6169:x1874203848500864:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380330.337279:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380330.337309:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9aa00/0xcf3c46fdcad68f9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac1e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380330.337334:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9aa00/0xcf3c46fdcad68f9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac1e expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380330.337344:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9aa00/0xcf3c46fdcad68f9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac1e expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380330.337353:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9aa00, rc 0) 00000100:00100000:1.0:1787380330.337405:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+12:6169:x1874203848500864:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 Request processed in 141us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380330.337412:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 336 00000100:00100000:3.0:1787380330.341526:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380330.341794:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848500992 00000100:00100000:2.0:1787380330.342042:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848500992 00000100:00100000:2.0:1787380330.342144:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 337 00000100:00100000:2.0:1787380330.342154:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+12:6169:x1874203848500992:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380330.342286:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+12:6169:x1874203848500992:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 Request processed in 132us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380330.342293:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 337 00000100:00100000:3.0:1787380330.344138:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380330.348568:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848501120 00000100:00100000:1.0:1787380330.348581:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848501120 00000100:00100000:1.0:1787380330.348632:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 338 00000100:00100000:1.0:1787380330.348641:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+12:6169:x1874203848501120:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380330.348779:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+12:6169:x1874203848501120:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 Request processed in 139us (4646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380330.348787:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 338 00000100:00100000:3.0:1787380330.357397:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380330.358047:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848501248 00000100:00100000:1.0:1787380330.358056:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848501248 00000100:00100000:1.0:1787380330.358120:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 339 00000100:00100000:1.0:1787380330.358131:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+12:10772:x1874203848501248:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787380330.358270:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+12:10772:x1874203848501248:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 141us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380330.358279:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 339 00000100:00100000:3.0:1787380330.368446:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380330.368564:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848501376 00000100:00100000:0.0:1787380330.368573:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848501376 00000100:00100000:0.0:1787380330.368626:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 340 00000100:00100000:0.0:1787380330.368635:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+12:10772:x1874203848501376:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787380330.368766:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+12:10772:x1874203848501376:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 131us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380330.368774:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 340 00000100:00100000:3.0:1787380330.374329:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380330.374424:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848501504 00000100:00100000:2.0:1787380330.374432:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848501504 00000100:00100000:2.0:1787380330.374488:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 341 00000100:00100000:2.0:1787380330.374498:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+12:6169:x1874203848501504:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380330.374512:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380330.374529:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5d47600/0xcf3c46fdcad68fa4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac25 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380330.374552:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5d47600/0xcf3c46fdcad68fa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac25 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380330.374563:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5d47600/0xcf3c46fdcad68fa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac25 expref: 13 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380330.374584:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d47600, rc 0) 00000100:00100000:2.0:1787380330.374640:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:6169:x1874203848501504:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 Request processed in 143us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380330.374647:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 341 00000100:00100000:3.0:1787380330.377167:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380330.379202:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848501632 00000100:00100000:1.0:1787380330.379215:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848501632 00000100:00100000:1.0:1787380330.379681:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 342 00000100:00100000:1.0:1787380330.379692:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:6169:x1874203848501632:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380330.379871:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:6169:x1874203848501632:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 Request processed in 179us (2710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380330.379879:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 342 00000100:00100000:3.0:1787380330.385318:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380330.385605:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848501760 00000100:00100000:0.0:1787380330.385615:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848501760 00000100:00100000:0.0:1787380330.385672:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 343 00000100:00100000:0.0:1787380330.385682:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:6169:x1874203848501760:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380330.385836:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:6169:x1874203848501760:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 Request processed in 154us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380330.385845:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 343 00000100:00100000:3.0:1787380330.398033:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380330.398346:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848501888 00000100:00100000:1.0:1787380330.398355:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848501888 00000100:00100000:1.0:1787380330.398410:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 344 00000100:00100000:1.0:1787380330.398420:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:10776:x1874203848501888:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787380330.398559:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:10776:x1874203848501888:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 140us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380330.398567:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 344 00000100:00100000:3.0:1787380330.401702:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380330.408223:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848502016 00000100:00100000:2.0:1787380330.408236:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848502016 00000100:00100000:2.0:1787380330.408292:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 345 00000100:00100000:2.0:1787380330.408301:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:10776:x1874203848502016:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787380330.408430:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:10776:x1874203848502016:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 129us (6734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380330.408438:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 345 00010000:00010000:3.0:1787380330.571981:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787380330.764105:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787380330.764112:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fff5a3000 from 7 10000000:01000000:2.0:1787380330.764117:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787380330.764161:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47e00/0xcf3c46fdcad68fab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380330.764173:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47e00/0xcf3c46fdcad68fab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380330.764184:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47e00/0xcf3c46fdcad68fab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380330.764207:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867457024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787380330.764267:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380330.764344:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4ec0780 going to sleep for 11 seconds 00000100:00100000:0.0:1787380330.764486:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867457024 00000100:00100000:0.0:1787380330.764494:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867457024 00000100:00100000:0.0:1787380330.764542:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1787380330.764551:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:6518:x1874203867457024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380330.764563:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380330.764574:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7866000/0xcf3c46fdcad68fb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68fab expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380330.764596:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7866000/0xcf3c46fdcad68fb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68fab expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380330.764606:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7866000/0xcf3c46fdcad68fb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68fab expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380330.764622:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866000, rc 0) 00000100:00100000:0.0:1787380330.764678:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867457024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380330.764685:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1787380330.764777:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867457024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380330.764791:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47e00/0xcf3c46fdcad68fab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68fb2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380330.764799:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47e00/0xcf3c46fdcad68fab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68fb2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380330.764874:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867457152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380330.764907:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380330.764940:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3c19d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380330.765201:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867457152 00000100:00100000:3.0:1787380330.765205:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867457152 00000100:00100000:3.0:1787380330.765234:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1787380330.765241:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867457152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380330.765357:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867457152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380330.765363:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1787380330.765479:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867457152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380330.765520:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867457280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380330.765558:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380330.765577:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3c19d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380330.766203:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867457280 00000100:00100000:2.0:1787380330.766208:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867457280 00000100:00100000:2.0:1787380330.766285:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1787380330.766293:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867457280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380330.766396:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867457280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380330.766402:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1787380330.766483:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867457280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380330.767548:0:13795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:13795:1874203867457408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380330.767600:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380330.770252:0:13795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3c19000 going to sleep for 11 seconds 00000100:00100000:0.0:1787380330.770503:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867457408 00000100:00100000:0.0:1787380330.770512:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867457408 00000100:00100000:0.0:1787380330.770562:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787380330.770571:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:13795:x1874203867457408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380330.770730:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:13795:x1874203867457408:12345-0@lo:502:llog_process_th.0 Request processed in 160us (3129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380330.770738:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1787380330.772717:0:13795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:13795:1874203867457408:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787380330.772759:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380330.772771:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380330.772774:0:13795:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787380330.772781:0:13795:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6fff5a3000 00000020:00000080:1.0:1787380330.772784:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787380330.772867:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380330.772870:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380330.772872:0:13795:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787380330.772875:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380330.772877:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380330.772878:0:13795:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787380330.772893:0:13795:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6fff5a3000 00000020:00000080:1.0:1787380330.772895:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787380330.772948:0:13795:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:13795:1874203867457536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380330.773010:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380330.773060:0:13795:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3c19000 going to sleep for 11 seconds 00000100:00100000:1.0:1787380330.776707:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867457536 00000100:00100000:1.0:1787380330.776717:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867457536 00000100:00100000:1.0:1787380330.776756:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1787380330.776772:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:13795:x1874203867457536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380330.777366:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:13795:x1874203867457536:12345-0@lo:502:llog_process_th.0 Request processed in 593us (4354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380330.777374:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1787380330.777433:0:13795:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:13795:1874203867457536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787380330.777463:0:13795:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380330.777470:0:13795:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380330.777472:0:13795:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787380330.777477:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787380330.777535:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787380330.777551:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787380330.777560:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47e00/0xcf3c46fdcad68fab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68fb2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380330.777570:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47e00/0xcf3c46fdcad68fab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68fb2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380330.777580:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787380330.777582:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ff5cad800 from 7 10000000:01000000:1.0:1787380330.777584:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787380330.777609:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9be00/0xcf3c46fdcad68fb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380330.777617:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9be00/0xcf3c46fdcad68fb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380330.777627:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9be00/0xcf3c46fdcad68fb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380330.777706:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867457664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787380330.777742:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380330.777768:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3c19000 going to sleep for 11 seconds 00000100:00100000:1.0:1787380330.777780:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867457664 00000100:00100000:1.0:1787380330.777783:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867457664 00000100:00100000:1.0:1787380330.777800:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787380330.777805:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:6518:x1874203867457664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380330.777831:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380330.777842:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9a800/0xcf3c46fdcad68fc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68fb9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380330.777860:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9a800/0xcf3c46fdcad68fc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68fb9 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380330.777869:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9a800/0xcf3c46fdcad68fc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68fb9 expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380330.777877:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9a800, rc 0) 00000100:00100000:1.0:1787380330.779003:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867457664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1193us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380330.779077:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1787380330.779132:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867457664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380330.779146:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9be00/0xcf3c46fdcad68fb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68fc0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380330.779155:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9be00/0xcf3c46fdcad68fb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68fc0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380330.779205:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867457792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380330.779235:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380330.779250:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3c19000 going to sleep for 11 seconds 00000100:00100000:1.0:1787380330.779263:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867457792 00000100:00100000:1.0:1787380330.779267:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867457792 00000100:00100000:1.0:1787380330.779287:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787380330.779293:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867457792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380330.779372:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867457792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380330.779378:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1787380330.779399:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867457792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380330.779419:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867457920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380330.779449:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380330.779460:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3c19000 going to sleep for 11 seconds 00000100:00100000:1.0:1787380330.779470:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867457920 00000100:00100000:1.0:1787380330.779472:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867457920 00000100:00100000:1.0:1787380330.779488:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1787380330.779493:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867457920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380330.779550:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867457920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 56us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380330.779556:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1787380330.779585:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867457920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380330.779833:0:13797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:13797:1874203867458048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380330.779865:0:13797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380330.779881:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867458048 00000100:00100000:1.0:1787380330.779890:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867458048 00000100:00100000:2.0:1787380330.782149:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787380330.782165:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:13797:x1874203867458048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380330.782297:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:13797:x1874203867458048:12345-0@lo:502:llog_process_th.0 Request processed in 138us (2431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380330.782305:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787380330.782369:0:13797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3d426c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380330.782391:0:13797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:13797:1874203867458048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787380330.782418:0:13797:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787380330.782426:0:13797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380330.782428:0:13797:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787380330.782434:0:13797:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6ff5cad800 00000020:00000080:2.0:1787380330.782436:0:13797:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787380330.782495:0:13797:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380330.782499:0:13797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380330.782501:0:13797:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787380330.782503:0:13797:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787380330.782505:0:13797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380330.782506:0:13797:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787380330.782509:0:13797:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6ff5cad800 00000020:00000080:2.0:1787380330.782511:0:13797:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787380330.782551:0:13797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:13797:1874203867458176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380330.782594:0:13797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380330.782610:0:13797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fb9780 going to sleep for 11 seconds 00000100:00100000:2.0:1787380330.782623:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867458176 00000100:00100000:2.0:1787380330.782628:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867458176 00000100:00100000:2.0:1787380330.782664:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787380330.782669:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:13797:x1874203867458176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380330.782728:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:13797:x1874203867458176:12345-0@lo:502:llog_process_th.0 Request processed in 58us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380330.782734:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1787380330.782769:0:13797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:13797:1874203867458176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787380330.782788:0:13797:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380330.782792:0:13797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380330.782794:0:13797:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787380330.782796:0:13797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1787380330.783601:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1787380330.783622:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787380330.783632:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9be00/0xcf3c46fdcad68fb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68fc0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380330.783643:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9be00/0xcf3c46fdcad68fb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68fc0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380330.783652:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787380330.783655:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ff3dad800 from 7 10000000:01000000:2.0:1787380330.783657:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787380330.783681:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68fc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380330.783688:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68fc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380330.783705:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68fc7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380330.783721:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867458304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787380330.783756:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380330.783775:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc821b900 going to sleep for 11 seconds 00000100:00100000:2.0:1787380330.783790:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867458304 00000100:00100000:2.0:1787380330.783794:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867458304 00000100:00100000:2.0:1787380330.783837:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1787380330.783844:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:6518:x1874203867458304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380330.783854:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380330.783864:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5d47a00/0xcf3c46fdcad68fce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68fc7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380330.783884:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5d47a00/0xcf3c46fdcad68fce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68fc7 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380330.787122:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5d47a00/0xcf3c46fdcad68fce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68fc7 expref: 23 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380330.787135:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d47a00, rc 0) 00000100:00100000:2.0:1787380330.787211:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867458304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3365us (3452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380330.787220:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1787380330.787407:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867458304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380330.787426:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68fc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68fce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380330.787436:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68fc7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68fce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380330.787507:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867458432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380330.787540:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380330.787565:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3d420c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380330.787622:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867458432 00000100:00100000:3.0:1787380330.787628:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867458432 00000100:00100000:3.0:1787380330.787678:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1787380330.787687:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867458432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380330.787797:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867458432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380330.787844:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787380330.788236:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e32a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867458432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380330.788266:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867458560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380330.788306:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380330.788322:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc821b600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380330.788364:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867458560 00000100:00100000:3.0:1787380330.788368:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867458560 00000100:00100000:3.0:1787380330.788394:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1787380330.788400:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867458560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380330.788473:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867458560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380330.788480:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1787380330.788574:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867458560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380330.788946:0:13798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:13798:1874203867458688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380330.788979:0:13798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380330.789005:0:13798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc821b240 going to sleep for 11 seconds 00000100:00100000:1.0:1787380330.789195:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867458688 00000100:00100000:1.0:1787380330.789200:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867458688 00000100:00100000:1.0:1787380330.789222:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787380330.789228:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:13798:x1874203867458688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380330.789307:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:13798:x1874203867458688:12345-0@lo:502:llog_process_th.0 Request processed in 78us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380330.789314:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1787380330.789373:0:13798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:13798:1874203867458688:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787380330.789393:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787380330.789402:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380330.789403:0:13798:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787380330.789409:0:13798:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6ff3dad800 00000020:00000080:2.0:1787380330.789412:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787380330.789465:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380330.789469:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380330.789471:0:13798:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787380330.789473:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787380330.789475:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380330.789477:0:13798:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787380330.789480:0:13798:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6ff3dad800 00000020:00000080:2.0:1787380330.789482:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787380330.789511:0:13798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:13798:1874203867458816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380330.789544:0:13798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380330.789555:0:13798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc821b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787380330.789606:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867458816 00000100:00100000:3.0:1787380330.789611:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867458816 00000100:00100000:3.0:1787380330.789648:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1787380330.789655:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:13798:x1874203867458816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380330.789714:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:13798:x1874203867458816:12345-0@lo:502:llog_process_th.0 Request processed in 60us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380330.789721:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1787380330.790524:0:13798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:13798:1874203867458816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787380330.790548:0:13798:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380330.790552:0:13798:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380330.790554:0:13798:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787380330.790562:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787380330.792733:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1787380330.792764:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787380330.792775:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68fc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68fce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380330.792787:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68fc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68fce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380330.792798:0:6518:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787380330.792800:0:6518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fc873b000 from 7 10000000:01000000:1.0:1787380330.792838:0:6518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787380330.792870:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68fd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380330.792879:0:6518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68fd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380330.793079:0:6518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68fd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380330.793112:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867458944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787380330.793199:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380330.793231:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3d42000 going to sleep for 11 seconds 00000100:00100000:2.0:1787380330.793688:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867458944 00000100:00100000:2.0:1787380330.793696:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867458944 00000100:00100000:2.0:1787380330.793900:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1787380330.794600:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:6518:x1874203867458944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380330.794614:0:6515:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380330.794629:0:6515:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5d46600/0xcf3c46fdcad68fdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad68fd5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380330.794653:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5d46600/0xcf3c46fdcad68fdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad68fd5 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380330.794664:0:6515:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5d46600/0xcf3c46fdcad68fdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad68fd5 expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380330.794672:0:6515:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46600, rc 0) 00000100:00100000:2.0:1787380330.794747:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:6518:x1874203867458944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 261us (1535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380330.795115:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867458944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380330.795131:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68fd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68fdc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380330.795140:0:6518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68fd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68fdc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380330.795211:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867459072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380330.795246:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380330.795280:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc12eda80 going to sleep for 11 seconds 00000100:00100000:1.0:1787380330.796870:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867459072 00000100:00100000:1.0:1787380330.796879:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867459072 00000100:00100000:1.0:1787380330.797783:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1787380330.797793:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+25:6518:x1874203867459072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380330.798304:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+25:6518:x1874203867459072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 511us (3056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380330.798313:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1787380330.800441:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1787380330.802597:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867459072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380330.802720:0:6518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867459200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380330.802782:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380330.802897:0:6518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc12eda80 going to sleep for 11 seconds 00000100:00100000:1.0:1787380330.810326:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867459200 00000100:00100000:1.0:1787380330.810338:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867459200 00000100:00100000:1.0:1787380330.810384:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787380330.810393:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:6518:x1874203867459200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380330.810526:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:6518:x1874203867459200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (7743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380330.810533:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1787380330.810581:0:6518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1e31f5e-7395-4c34-a795-7159073dc2a2:6518:1874203867459200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380330.811847:0:13801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:13801:1874203867459328:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787380330.812424:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787380330.812755:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380330.812796:0:13801:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3d42600 going to sleep for 11 seconds 00000100:00100000:0.0:1787380330.813720:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867459328 00000100:00100000:0.0:1787380330.813729:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867459328 00000100:00100000:0.0:1787380330.813768:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1787380330.813776:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:13801:x1874203867459328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380330.816306:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:13801:x1874203867459328:12345-0@lo:502:llog_process_th.0 Request processed in 2523us (3544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380330.816320:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1787380330.817199:0:13801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:13801:1874203867459328:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787380330.817235:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380330.817246:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380330.817248:0:13801:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787380330.817255:0:13801:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6fc873b000 00000020:00000080:1.0:1787380330.817257:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787380330.817313:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380330.817317:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380330.817319:0:13801:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787380330.817322:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380330.817325:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380330.817326:0:13801:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787380330.817329:0:13801:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6fc873b000 00000020:00000080:1.0:1787380330.817332:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787380330.817375:0:13801:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:13801:1874203867459456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380330.817433:0:13801:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380330.820215:0:13801:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3d42600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380330.820426:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867459456 00000100:00100000:3.0:1787380330.820436:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867459456 00000100:00100000:3.0:1787380330.820485:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1787380330.820493:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:13801:x1874203867459456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380330.821440:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:13801:x1874203867459456:12345-0@lo:502:llog_process_th.0 Request processed in 943us (4002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380330.821451:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1787380330.821538:0:13801:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1e31f5e-7395-4c34-a795-7159073dc2a2:13801:1874203867459456:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787380330.821571:0:13801:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380330.821578:0:13801:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380330.821581:0:13801:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787380330.821709:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1787380330.822564:0:6518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1787380330.822592:0:6518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787380330.822602:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68fd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68fdc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380330.822693:0:6518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68fd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68fdc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787380330.849458:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787380331.148514:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec335a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867459584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380331.148589:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380331.148614:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867459584 00000100:00100000:0.0:1787380331.148621:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867459584 00000100:00080000:3.0:1787380331.148659:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787380331.148941:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867459840:0@lo:400:kworker.0 00000100:00100000:1.0:1787380331.149144:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380331.155513:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787380331.155600:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec335b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867459584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787380331.155632:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380331.155710:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec335b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867459584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (7121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380331.156676:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867460352:0@lo:400:kworker.0 00000100:00100000:1.0:1787380331.156768:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380331.156826:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1874203867460864:0@lo:400:kworker.0 00000100:00100000:1.0:1787380331.156849:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380331.156896:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867460352 00000100:00100000:1.0:1787380331.156916:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867460352 00000100:00100000:1.0:1787380331.156969:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867460864 00000100:00100000:1.0:1787380331.156972:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867460864 00000100:00100000:1.0:1787380331.156992:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787380331.156999:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867460352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380331.157200:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867460352:12345-0@lo:400:kworker.0 Request processed in 200us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380331.157207:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1787380331.157223:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787380331.157230:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874203867460864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380331.157256:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874203867460864:12345-0@lo:400:kworker.0 Request processed in 27us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380331.157262:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1787380331.157287:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867459968:0@lo:400:kworker.0 00000100:00100000:1.0:1787380331.157311:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380331.157332:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867460480:0@lo:400:kworker.0 00000100:00100000:1.0:1787380331.157353:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380331.157368:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867460992:0@lo:400:kworker.0 00000100:00100000:1.0:1787380331.157384:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380331.157406:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787380331.157412:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867460096:0@lo:400:kworker.0 00000100:00100000:1.0:1787380331.157463:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380331.157482:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867460608:0@lo:400:kworker.0 00000100:00100000:1.0:1787380331.157501:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380331.157516:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867461120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787380331.157534:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380331.157554:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867460480 00000100:00100000:1.0:1787380331.157557:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867460480 00000100:00100000:1.0:1787380331.157584:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867460992 00000100:00100000:1.0:1787380331.157587:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867460992 00000100:00100000:1.0:1787380331.157606:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867460608 00000100:00100000:1.0:1787380331.157609:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867460608 00000100:00100000:1.0:1787380331.157624:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787380331.157630:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867460480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380331.157674:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867460480:12345-0@lo:400:kworker.0 Request processed in 43us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380331.157680:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787380331.157693:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787380331.157699:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867460992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380331.157725:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867460992:12345-0@lo:400:kworker.0 Request processed in 27us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380331.157730:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787380331.157740:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787380331.157746:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1874203867460608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380331.157770:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3641:x1874203867460608:12345-0@lo:400:kworker.0 Request processed in 25us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380331.157776:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787380331.157799:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867459840 00000100:00100000:1.0:1787380331.157803:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867459840 00000100:00100000:1.0:1787380331.157847:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867460096 00000100:00100000:1.0:1787380331.157850:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867460096 00000100:00100000:1.0:1787380331.157862:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787380331.157867:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867459840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380331.157912:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867459840:12345-0@lo:400:kworker.0 Request processed in 34us (8891us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380331.157918:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787380331.159861:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867459712:0@lo:400:kworker.0 00000100:00100000:3.0:1787380331.159925:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380331.159964:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867460224:0@lo:400:kworker.0 00000100:00100000:3.0:1787380331.159996:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380331.160016:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867460736:0@lo:400:kworker.0 00000100:00100000:3.0:1787380331.160033:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380331.160157:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867459968 00000100:00100000:3.0:1787380331.160164:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867459968 00000100:00100000:3.0:1787380331.160197:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867459712 00000100:00100000:3.0:1787380331.160200:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867459712 00000100:00100000:3.0:1787380331.160212:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867460224 00000100:00100000:3.0:1787380331.160214:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867460224 00000100:00100000:3.0:1787380331.160226:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867460736 00000100:00100000:3.0:1787380331.160227:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867460736 00000100:00100000:3.0:1787380331.160242:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1787380331.160251:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867459968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380331.160552:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867459968:12345-0@lo:400:kworker.0 Request processed in 302us (3239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380331.160561:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1787380331.160773:0:8437:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787380331.160783:0:8437:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1787380331.160819:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787380331.160830:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867460096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380331.160893:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867460096:12345-0@lo:400:kworker.0 Request processed in 57us (3421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380331.160899:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1787380331.161648:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787380331.161655:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787380331.161658:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787380331.161660:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787380331.164068:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787380331.164114:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867461120 00000100:00100000:0.0:1787380331.164122:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867461120 00000100:00100000:0.0:1787380331.164153:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787380331.164159:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867461120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787380331.164181:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380331.164249:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867461120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (6713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380331.164255:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787380331.164547:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867459840:0@lo:400:kworker.0 00010000:00080000:0.0:1787380331.164567:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3684700 x1874203867460352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380331.164799:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867460352:0@lo:400:kworker.0 00010000:00080000:0.0:1787380331.165159:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3c17b80 x1874203867460864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380331.165169:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1874203867460864:0@lo:400:kworker.0 00000100:00100000:0.0:1787380331.165197:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380331.165207:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867461248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380331.165251:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380331.165323:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867460096:0@lo:400:kworker.0 00000100:00100000:0.0:1787380331.165339:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867460608:0@lo:400:kworker.0 00010000:00080000:0.0:1787380331.165351:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3698380 x1874203867461120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380331.165367:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867461120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380331.165380:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867459968:0@lo:400:kworker.0 00000100:00100000:0.0:1787380331.165391:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867460480:0@lo:400:kworker.0 00000100:00100000:2.0:1787380331.165445:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1787380331.165457:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867459712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380331.165523:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867459712:12345-0@lo:400:kworker.0 Request processed in 70us (5597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380331.165531:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1787380331.165543:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1787380331.165572:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787380331.165573:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867460224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380331.165617:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867460224:12345-0@lo:400:kworker.0 Request processed in 51us (5619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380331.165624:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1787380331.165670:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867459712:0@lo:400:kworker.0 00000100:00100000:3.0:1787380331.165682:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867460224:0@lo:400:kworker.0 00010000:00080000:3.0:1787380331.165726:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec335a680 x1874203867459584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380331.165741:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec335a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867459584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380331.165782:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867461248 00000100:00100000:3.0:1787380331.165788:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867461248 00000100:00100000:3.0:1787380331.165833:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787380331.165840:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867461248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787380331.165865:0:13003:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1787380331.165904:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867461248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380331.165911:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787380331.165941:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867461248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380331.165985:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec335ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867460736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380331.166034:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec335ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867460736:12345-0@lo:400:kworker.0 Request processed in 452us (5998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380331.166043:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1787380331.166067:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867460736:0@lo:400:kworker.0 00010000:00080000:0.0:1787380331.166301:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3c16300 x1874203867460992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380331.166368:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867460992:0@lo:400:kworker.0 00010000:00010000:1.0:1787380331.596014:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380331.661852:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867461504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380331.661936:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380331.662043:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867461504 00000100:00100000:1.0:1787380331.662051:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867461504 00000100:00100000:1.0:1787380331.662106:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787380331.662115:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867461504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787380331.662141:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380331.663062:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867461376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380331.663117:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380331.663171:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867461376 00000100:00100000:3.0:1787380331.663177:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867461376 00000100:00100000:3.0:1787380331.663201:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787380331.663222:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1874203867461376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787380331.663238:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380331.663273:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1874203867461376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380331.663280:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787380331.663351:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867461376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380331.668460:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867461504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6336us (6514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380331.668474:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787380331.670616:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867461504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380331.681112:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380331.681157:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380331.681197:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380331.681429:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848502400 00000100:00100000:2.0:1787380331.681439:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848502400 00000100:00100000:2.0:1787380331.681490:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848502656 00000100:00100000:2.0:1787380331.681494:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848502656 00000100:00100000:2.0:1787380331.681514:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 217 00000100:00100000:2.0:1787380331.681524:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec335a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848502400:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380331.681588:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec335a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848502400:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 65us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380331.681595:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 217 00000100:00100000:2.0:1787380331.681613:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 218 00000100:00100000:2.0:1787380331.681619:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848502656:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380331.681645:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848502656:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 26us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380331.681651:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 218 00000100:00100000:3.0:1787380331.681780:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380331.681838:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380331.681861:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380331.682019:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848502272 00000100:00100000:2.0:1787380331.682023:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848502272 00000100:00100000:2.0:1787380331.682044:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848502784 00000100:00100000:2.0:1787380331.682047:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848502784 00000100:00100000:2.0:1787380331.682079:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 219 00000100:00100000:2.0:1787380331.682098:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848502272:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380331.682132:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848502272:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 35us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380331.682139:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 219 00000100:00100000:2.0:1787380331.682152:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 220 00000100:00100000:2.0:1787380331.682158:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848502784:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380331.682255:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848502784:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 95us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380331.682262:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 220 00000100:00080000:1.0:1787380331.682336:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787380331.682340:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787380331.682351:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848502528 00000100:00100000:1.0:1787380331.682355:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848502528 00000100:00100000:1.0:1787380331.682398:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 82 00000100:00100000:1.0:1787380331.682406:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848502528:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380331.682436:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848502528:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 31us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380331.682449:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 82 00000100:00080000:2.0:1787380331.682538:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380331.683245:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848502144 00000100:00100000:0.0:1787380331.683253:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848502144 00000100:00100000:0.0:1787380331.683299:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 366 00000100:00100000:0.0:1787380331.683307:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2398:x1874203848502144:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380331.683343:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2398:x1874203848502144:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 38us (2239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380331.683350:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 366 00000040:00080000:0.0:1787380331.853457:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787380331.855373:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787380332.623589:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380332.684107:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380332.684129:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867461632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787380332.684191:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380332.684342:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867461632 00000100:00100000:1.0:1787380332.684351:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867461632 00000100:00100000:1.0:1787380332.684404:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787380332.684413:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867461632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380332.684457:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380332.684518:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867461632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380332.684526:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787380332.684790:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867461632:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787380333.643974:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380334.668566:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787380334.737126:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:2.0:1787380335.693587:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380336.268373:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867462016:0@lo:400:kworker.0 00000100:00100000:2.0:1787380336.268441:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380336.268497:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787380336.268505:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867462144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380336.268573:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380336.268970:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867461888:0@lo:400:kworker.0 00000100:00100000:1.0:1787380336.269005:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380336.269042:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380336.269049:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867461760:0@lo:400:kworker.0 00000100:00100000:1.0:1787380336.269092:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380336.269499:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867462528:0@lo:400:kworker.0 00000100:00100000:0.0:1787380336.269528:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380336.269546:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867463040:0@lo:400:kworker.0 00000100:00100000:0.0:1787380336.269564:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380336.269580:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787380336.269585:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1874203867462656:0@lo:400:kworker.0 00000100:00100000:0.0:1787380336.269602:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380336.269627:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867463168:0@lo:400:kworker.0 00000100:00100000:0.0:1787380336.269959:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380336.270045:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867462400:0@lo:400:kworker.0 00000100:00100000:1.0:1787380336.270089:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380336.270115:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867462912:0@lo:400:kworker.0 00000100:00100000:1.0:1787380336.270143:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380336.270201:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867462272:0@lo:400:kworker.0 00000100:00100000:0.0:1787380336.270250:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867462016 00000100:00100000:0.0:1787380336.270258:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867462016 00000100:00100000:1.0:1787380336.270508:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867462912 00000100:00100000:1.0:1787380336.270513:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867462912 00000100:00100000:1.0:1787380336.270552:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787380336.270560:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867462912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380336.270607:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867462400 00000100:00100000:0.0:1787380336.270611:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867462400 00000100:00100000:0.0:1787380336.270640:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787380336.270656:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867462016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380336.270725:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867461888 00000100:00100000:2.0:1787380336.270730:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867461888 00000100:00100000:2.0:1787380336.270750:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867462528 00000100:00100000:2.0:1787380336.270753:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867462528 00000100:00100000:2.0:1787380336.270765:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867463040 00000100:00100000:2.0:1787380336.270768:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867463040 00000100:00100000:2.0:1787380336.270777:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867462656 00000100:00100000:2.0:1787380336.270779:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867462656 00000100:00100000:2.0:1787380336.270798:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867463168 00000100:00100000:2.0:1787380336.270801:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867463168 00000100:00100000:2.0:1787380336.270836:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787380336.270842:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867461888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380336.277417:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380336.277452:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867462784:0@lo:400:kworker.0 00000100:00100000:3.0:1787380336.277483:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380336.277511:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867463296:0@lo:400:kworker.0 00000100:00100000:3.0:1787380336.277531:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380336.277582:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787380336.277595:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867462400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380336.277650:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867462400:12345-0@lo:400:kworker.0 Request processed in 59us (7559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380336.277658:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787380336.277698:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867462144 00000100:00100000:3.0:1787380336.277705:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867462144 00000100:00100000:3.0:1787380336.277741:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787380336.277748:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867462144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787380336.277766:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380336.277802:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867462144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (9228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380336.277823:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787380336.277850:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867461760 00000100:00100000:3.0:1787380336.277853:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867461760 00000100:00100000:3.0:1787380336.277890:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1787380336.277896:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3640:x1874203867461760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380336.277944:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3640:x1874203867461760:12345-0@lo:400:kworker.0 Request processed in 48us (8852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380336.277951:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1787380336.278033:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867462784 00000100:00100000:3.0:1787380336.278037:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867462784 00000100:00100000:3.0:1787380336.278071:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867463296 00000100:00100000:3.0:1787380336.278074:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867463296 00000100:00100000:3.0:1787380336.278091:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787380336.278097:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867462784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380336.278127:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867462784:12345-0@lo:400:kworker.0 Request processed in 30us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380336.278133:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787380336.278365:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867462912:12345-0@lo:400:kworker.0 Request processed in 7804us (8218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380336.278384:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787380336.278402:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787380336.278410:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867463296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380336.278442:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867463296:12345-0@lo:400:kworker.0 Request processed in 34us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380336.278448:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1787380336.278472:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787380336.278476:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787380336.278479:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787380336.278481:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380336.278621:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867462016:12345-0@lo:400:kworker.0 Request processed in 7973us (10178us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380336.278639:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787380336.278667:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867463552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380336.278697:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787380336.278738:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec369b100 x1874203867462144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380336.278755:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec369b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867462144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380336.278782:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867462016:0@lo:400:kworker.0 00000100:00100000:0.0:1787380336.278824:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867463552 00000100:00100000:0.0:1787380336.278828:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867463552 00000100:00100000:2.0:1787380336.279174:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867461888:12345-0@lo:400:kworker.0 Request processed in 8331us (10167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380336.279184:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787380336.279201:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867462272 00000100:00100000:2.0:1787380336.279205:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867462272 00000100:00100000:2.0:1787380336.279225:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787380336.279232:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867462528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380336.279270:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867462528:12345-0@lo:400:kworker.0 Request processed in 39us (9741us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380336.279277:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787380336.279289:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787380336.279295:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867463040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380336.279323:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867463040:12345-0@lo:400:kworker.0 Request processed in 29us (9757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380336.279329:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787380336.279340:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787380336.279347:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874203867462656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380336.279372:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874203867462656:12345-0@lo:400:kworker.0 Request processed in 26us (9769us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380336.279378:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787380336.279389:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787380336.279395:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874203867463168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380336.279435:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874203867463168:12345-0@lo:400:kworker.0 Request processed in 40us (9475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380336.279441:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787380336.279453:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787380336.279458:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867462272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380336.279481:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867462272:12345-0@lo:400:kworker.0 Request processed in 24us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380336.279487:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787380336.279547:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867463424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380336.279575:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380336.279605:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867462400:0@lo:400:kworker.0 00000100:00100000:2.0:1787380336.279616:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1787380336.279620:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6ec336e300, transno 4294967301 00000100:00100000:2.0:1787380336.279701:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867462912:0@lo:400:kworker.0 00000100:00100000:2.0:1787380336.279714:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867461760:0@lo:400:kworker.0 00000100:00100000:2.0:1787380336.279725:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867461888:0@lo:400:kworker.0 00010000:00080000:1.0:1787380336.281254:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3685500 x1874203867462656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380336.281269:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1874203867462656:0@lo:400:kworker.0 00010000:00080000:1.0:1787380336.281282:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff4e33800 x1874203867463168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380336.281290:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867463168:0@lo:400:kworker.0 00000100:00100000:1.0:1787380336.281301:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867462528:0@lo:400:kworker.0 00000100:00100000:1.0:1787380336.281311:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867463040:0@lo:400:kworker.0 00000100:00100000:0.0:1787380336.281517:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787380336.281531:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867463552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787380336.281553:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380336.281615:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867463552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (2917us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380336.281621:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1787380336.281862:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec20a5f80 x1874203867463552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380336.281878:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867463552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380336.281957:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867462272:0@lo:400:kworker.0 00000100:00100000:2.0:1787380336.281969:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867462784:0@lo:400:kworker.0 00010000:00080000:2.0:1787380336.281979:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff4e31c00 x1874203867463296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380336.281987:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867463296:0@lo:400:kworker.0 00000100:00100000:2.0:1787380336.282018:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867463424 00000100:00100000:2.0:1787380336.282159:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867463424 00000100:00100000:2.0:1787380336.282198:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787380336.282205:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec369aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867463424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787380336.282229:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1787380336.282267:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec369aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867463424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (2691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380336.282273:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787380336.282307:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867463424:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1787380336.716130:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380336.780260:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec36d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867463680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380336.780329:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380336.780551:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867463680 00000100:00100000:0.0:1787380336.780558:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867463680 00000100:00100000:0.0:1787380336.780629:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787380336.780638:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec369b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867463680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380336.780665:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380336.780724:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec369b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867463680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380336.780745:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787380336.780845:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec36d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867463680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380336.780869:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380336.780877:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec36d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867463808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787380336.780906:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380336.784890:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867463808 00000100:00100000:0.0:1787380336.784903:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867463808 00000100:00100000:0.0:1787380336.784978:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787380336.784987:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867463808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787380336.785197:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380336.785293:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867463808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 306us (4385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380336.785300:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787380336.785510:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec36d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867463808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787380336.800574:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380336.800634:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380336.800661:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380336.800685:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380336.800702:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380336.800771:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380336.800851:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848502912 00000100:00100000:1.0:1787380336.800860:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848502912 00000100:00100000:1.0:1787380336.800932:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 368 00000100:00100000:1.0:1787380336.800941:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2399:x1874203848502912:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380336.801021:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2399:x1874203848502912:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 80us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380336.801030:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 368 00000100:00100000:1.0:1787380336.801136:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848503040 00000100:00100000:1.0:1787380336.801141:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848503040 00000100:00100000:1.0:1787380336.801168:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848503168 00000100:00100000:1.0:1787380336.801171:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848503168 00000100:00100000:1.0:1787380336.801183:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848503424 00000100:00100000:1.0:1787380336.801185:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848503424 00000100:00100000:1.0:1787380336.801196:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848503552 00000100:00100000:1.0:1787380336.801198:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848503552 00000100:00100000:1.0:1787380336.801223:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 227 00000100:00100000:1.0:1787380336.801230:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848503040:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380336.801267:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848503040:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 37us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380336.801274:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 227 00000100:00100000:1.0:1787380336.801287:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 228 00000100:00100000:1.0:1787380336.801293:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848503168:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380336.801316:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848503168:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 23us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380336.801322:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 228 00000100:00100000:1.0:1787380336.801332:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 229 00000100:00100000:1.0:1787380336.801338:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2399:x1874203848503424:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380336.801357:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2399:x1874203848503424:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 20us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380336.801370:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 229 00000100:00100000:1.0:1787380336.801394:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 230 00000100:00100000:1.0:1787380336.801400:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848503552:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380336.801423:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848503552:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 24us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380336.801430:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 230 00000100:00080000:1.0:1787380336.801491:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787380336.801496:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380336.801505:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848503296 00000100:00100000:1.0:1787380336.801508:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848503296 00000100:00100000:1.0:1787380336.801537:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 86 00000100:00100000:1.0:1787380336.801543:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848503296:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380336.801570:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848503296:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 27us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380336.801576:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 86 00000100:00080000:1.0:1787380336.801592:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787380337.741728:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380337.804864:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec36d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867463936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787380337.804932:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380337.805070:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867463936 00000100:00100000:1.0:1787380337.805078:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867463936 00000100:00100000:1.0:1787380337.805128:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787380337.805136:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867463936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380337.805167:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380337.805211:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867463936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380337.805218:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787380337.805596:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec36d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867463936:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787380338.764061:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380339.789712:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380340.814478:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787380341.069187:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1787380341.070774:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787380341.388774:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5dc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867464064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380341.388861:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380341.389402:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec36d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867464448:0@lo:400:kworker.0 00000100:00100000:1.0:1787380341.389451:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380341.389472:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867464960:0@lo:400:kworker.0 00000100:00100000:1.0:1787380341.389496:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380341.389511:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1874203867465472:0@lo:400:kworker.0 00000100:00100000:1.0:1787380341.389530:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380341.389549:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787380341.389555:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec36d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867464320:0@lo:400:kworker.0 00000100:00100000:1.0:1787380341.389574:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380341.389588:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1874203867464832:0@lo:400:kworker.0 00000100:00100000:1.0:1787380341.389606:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380341.389623:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1874203867465344:0@lo:400:kworker.0 00000100:00100000:1.0:1787380341.389642:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380341.389848:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867464960 00000100:00100000:3.0:1787380341.389854:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867464960 00000100:00100000:3.0:1787380341.389899:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867465472 00000100:00100000:3.0:1787380341.389902:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867465472 00000100:00100000:3.0:1787380341.389916:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867464320 00000100:00100000:3.0:1787380341.389918:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867464320 00000100:00100000:3.0:1787380341.389928:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867464832 00000100:00100000:3.0:1787380341.389930:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867464832 00000100:00100000:3.0:1787380341.389941:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867465344 00000100:00100000:3.0:1787380341.389942:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867465344 00000100:00100000:3.0:1787380341.389956:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787380341.389963:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867464960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380341.390014:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867464960:12345-0@lo:400:kworker.0 Request processed in 51us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380341.390021:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787380341.390056:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787380341.390062:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874203867465472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380341.390087:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874203867465472:12345-0@lo:400:kworker.0 Request processed in 26us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380341.390093:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787380341.390104:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787380341.390109:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867464320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380341.390129:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867464320:12345-0@lo:400:kworker.0 Request processed in 21us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380341.390134:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787380341.390150:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787380341.390156:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874203867464832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380341.390179:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874203867464832:12345-0@lo:400:kworker.0 Request processed in 23us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380341.390191:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787380341.390203:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787380341.390215:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874203867465344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380341.390238:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874203867465344:12345-0@lo:400:kworker.0 Request processed in 30us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380341.390243:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787380341.390263:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867464576:0@lo:400:kworker.0 00000100:00100000:3.0:1787380341.390292:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380341.390310:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867465088:0@lo:400:kworker.0 00000100:00100000:3.0:1787380341.390604:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380341.390627:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867465600:0@lo:400:kworker.0 00000100:00100000:3.0:1787380341.390653:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380341.390671:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1787380341.390677:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec36d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867464192:0@lo:400:kworker.0 00000100:00100000:3.0:1787380341.390701:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380341.391720:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867465088 00000100:00100000:2.0:1787380341.391734:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867465088 00000100:00100000:2.0:1787380341.391772:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867465600 00000100:00100000:2.0:1787380341.391775:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867465600 00000100:00100000:2.0:1787380341.391801:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787380341.391822:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867465088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380341.391870:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867465088:12345-0@lo:400:kworker.0 Request processed in 62us (1464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380341.391877:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787380341.392428:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867464704:0@lo:400:kworker.0 00000100:00100000:3.0:1787380341.392467:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380341.392492:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867465216:0@lo:400:kworker.0 00000100:00100000:3.0:1787380341.392513:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380341.392531:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867465728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380341.392560:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380341.392603:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867465088:0@lo:400:kworker.0 00000100:00100000:2.0:1787380341.392647:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867465216 00000100:00100000:2.0:1787380341.392652:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867465216 00000100:00100000:2.0:1787380341.392680:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787380341.392687:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffcb1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867465600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380341.392732:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffcb1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867465600:12345-0@lo:400:kworker.0 Request processed in 46us (2078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380341.392738:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787380341.392905:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787380341.392911:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867465216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380341.392939:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867465216:12345-0@lo:400:kworker.0 Request processed in 29us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380341.392951:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787380341.393011:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867464192 00000100:00100000:2.0:1787380341.393015:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867464192 00000100:00100000:2.0:1787380341.393053:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1787380341.393060:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867464192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380341.393112:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867464192:12345-0@lo:400:kworker.0 Request processed in 52us (2409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380341.393119:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1787380341.393372:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867464064 00000100:00100000:0.0:1787380341.393383:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867464064 00000100:00100000:0.0:1787380341.393413:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867465728 00000100:00100000:0.0:1787380341.393416:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867465728 00000100:00100000:0.0:1787380341.393429:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787380341.393436:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867464064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787380341.393455:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380341.393489:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867464064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (4627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380341.393495:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787380341.393507:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787380341.393513:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867465728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787380341.393522:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380341.393545:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867465728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380341.393900:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787380341.393934:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867465856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380341.393966:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380341.394003:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867464576 00000100:00100000:0.0:1787380341.394007:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867464576 00000100:00100000:1.0:1787380341.400216:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867464448 00000100:00100000:1.0:1787380341.400235:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867464448 00000100:00100000:1.0:1787380341.400295:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867464704 00000100:00100000:1.0:1787380341.400299:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867464704 00000100:00100000:1.0:1787380341.400312:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867465856 00000100:00100000:1.0:1787380341.400314:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867465856 00000100:00100000:1.0:1787380341.400342:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787380341.400352:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1874203867464448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380341.400452:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1874203867464448:12345-0@lo:400:kworker.0 Request processed in 101us (10999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380341.400460:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787380341.400475:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787380341.400481:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867464704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380341.400525:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867464704:12345-0@lo:400:kworker.0 Request processed in 44us (8058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380341.400531:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787380341.400542:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787380341.400547:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867465856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787380341.400568:0:13003:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787380341.400609:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867465856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (6642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380341.400615:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1787380341.400644:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787380341.400649:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787380341.400652:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787380341.400654:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787380341.400693:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec36d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867464320:0@lo:400:kworker.0 00000100:00100000:1.0:1787380341.400706:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1874203867464832:0@lo:400:kworker.0 00000100:00100000:1.0:1787380341.400715:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1874203867465344:0@lo:400:kworker.0 00000100:00100000:1.0:1787380341.400724:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec36d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867464448:0@lo:400:kworker.0 00010000:00080000:1.0:1787380341.400736:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc3b64a80 x1874203867464960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380341.400745:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867464960:0@lo:400:kworker.0 00010000:00080000:1.0:1787380341.400755:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc3b65f80 x1874203867465472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380341.400762:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1874203867465472:0@lo:400:kworker.0 00000100:00100000:1.0:1787380341.400869:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867465856:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380341.407954:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec36d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867464192:0@lo:400:kworker.0 00000100:00100000:3.0:1787380341.407995:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867464704:0@lo:400:kworker.0 00000100:00100000:3.0:1787380341.408009:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867465216:0@lo:400:kworker.0 00010000:00080000:3.0:1787380341.408024:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec20a7100 x1874203867465728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380341.408055:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867465728:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787380341.408068:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc3b67b80 x1874203867465600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380341.408076:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867465600:0@lo:400:kworker.0 00010000:00080000:3.0:1787380341.408089:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5dc9880 x1874203867464064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380341.408099:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5dc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867464064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380341.414639:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787380341.414661:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867464576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380341.414759:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867464576:12345-0@lo:400:kworker.0 Request processed in 108us (24465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380341.414766:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787380341.414857:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867464576:0@lo:400:kworker.0 00010000:00010000:2.0:1787380341.836127:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380341.900210:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380341.900235:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867465984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380341.900310:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380341.900428:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867465984 00000100:00100000:2.0:1787380341.900436:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867465984 00000100:00100000:2.0:1787380341.900488:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787380341.900505:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867465984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380341.900530:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380341.900589:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867465984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380341.900597:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787380341.900682:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867465984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380341.901742:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867466112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380341.901784:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380341.902053:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867466112 00000100:00100000:2.0:1787380341.902060:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867466112 00000100:00100000:2.0:1787380341.902103:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787380341.902111:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867466112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787380341.902127:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380341.902470:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867466112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 358us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380341.902478:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787380341.902887:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867466112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787380341.917288:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380341.917326:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380341.917349:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380341.917378:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380341.917408:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380341.917431:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380341.917462:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848503680 00000100:00100000:1.0:1787380341.917470:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848503680 00000100:00100000:1.0:1787380341.917514:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 370 00000100:00100000:1.0:1787380341.917522:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2400:x1874203848503680:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380341.917588:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2400:x1874203848503680:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 67us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380341.917605:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 370 00000100:00100000:0.0:1787380341.917609:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848503808 00000100:00100000:0.0:1787380341.917616:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848503808 00000100:00100000:0.0:1787380341.917663:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848504320 00000100:00100000:0.0:1787380341.917667:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848504320 00000100:00100000:0.0:1787380341.917680:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848503936 00000100:00100000:0.0:1787380341.917682:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848503936 00000100:00100000:0.0:1787380341.917697:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848504192 00000100:00100000:0.0:1787380341.917699:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848504192 00000100:00080000:1.0:1787380341.917715:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787380341.917720:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380341.917720:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 237 00000100:00100000:0.0:1787380341.917731:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848503808:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380341.917736:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 238 00000100:00100000:1.0:1787380341.917747:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848504320:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380341.917783:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848503808:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 54us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380341.917791:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848504320:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 44us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380341.917795:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 237 00000100:00100000:2.0:1787380341.917882:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848504064 00000100:00100000:2.0:1787380341.917888:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848504064 00000100:00100000:2.0:1787380341.917924:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 90 00000100:00100000:2.0:1787380341.917931:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848504064:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380341.917958:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848504064:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 28us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380341.917992:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 90 00000100:00100000:1.0:1787380341.917997:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 238 00000100:00080000:2.0:1787380341.918018:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380341.919067:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 239 00000100:00100000:0.0:1787380341.919090:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848503936:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380341.919461:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848503936:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 373us (2060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380341.919470:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 239 00000100:00100000:0.0:1787380341.919493:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 240 00000100:00100000:0.0:1787380341.919572:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848504192:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380341.919600:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848504192:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 32us (2168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380341.919607:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 240 00010000:00010000:3.0:1787380342.860004:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380342.924094:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380342.924116:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867466240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787380342.924184:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380342.924309:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867466240 00000100:00100000:1.0:1787380342.924317:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867466240 00000100:00100000:1.0:1787380342.924370:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787380342.924379:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867466240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380342.924437:0:13003:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380342.924488:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867466240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380342.924495:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787380342.924744:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867466240:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787380343.886644:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380344.908033:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380345.931949:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380346.508153:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380346.508179:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867466368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787380346.508245:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380346.508316:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867466496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380346.508332:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867466368 00000100:00100000:2.0:1787380346.508351:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867466368 00000100:00100000:1.0:1787380346.508365:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380346.508391:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867467008:0@lo:400:kworker.0 00000100:00100000:2.0:1787380346.508404:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867466496 00000100:00100000:2.0:1787380346.508409:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867466496 00000100:00100000:1.0:1787380346.508418:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380346.508433:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787380346.508439:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867467520:0@lo:400:kworker.0 00000100:00100000:2.0:1787380346.508445:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867466368:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787380346.508463:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1787380346.508477:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380346.508480:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867468032:0@lo:400:kworker.0 00000100:00100000:1.0:1787380346.508504:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380346.508593:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867466624:0@lo:400:kworker.0 00000100:00100000:2.0:1787380346.508634:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867466368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 192us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380346.508642:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787380346.508659:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787380346.508666:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867466496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787380346.508676:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380346.508761:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867466880:0@lo:400:kworker.0 00010000:00080000:1.0:1787380346.509284:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec20a5880 x1874203867466368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380346.509303:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867466368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787380346.510070:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867467008 00000100:00100000:1.0:1787380346.510078:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867467008 00000100:00100000:1.0:1787380346.510125:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1787380346.510133:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867467008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380346.512052:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380346.512115:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867467136:0@lo:400:kworker.0 00000100:00100000:3.0:1787380346.512152:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380346.512667:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867467648:0@lo:400:kworker.0 00000100:00100000:3.0:1787380346.512695:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380346.512716:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867468160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380346.512739:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380346.512963:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787380346.512972:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867466752:0@lo:400:kworker.0 00000100:00100000:3.0:1787380346.513139:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380346.513247:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867467264:0@lo:400:kworker.0 00000100:00100000:3.0:1787380346.513278:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380346.513298:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867467776:0@lo:400:kworker.0 00000100:00100000:3.0:1787380346.513326:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380346.514290:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867466624 00000100:00100000:3.0:1787380346.514551:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867466624 00000100:00100000:3.0:1787380346.514737:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1787380346.514748:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867466624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380346.515022:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867466624:12345-0@lo:400:kworker.0 Request processed in 275us (2975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380346.515035:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1787380346.515078:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867467520 00000100:00100000:3.0:1787380346.515083:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867467520 00000100:00100000:3.0:1787380346.515325:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867468032 00000100:00100000:3.0:1787380346.515333:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867468032 00000100:00100000:3.0:1787380346.515377:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867467648 00000100:00100000:3.0:1787380346.515380:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867467648 00000100:00100000:3.0:1787380346.515397:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787380346.515403:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867467520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380346.516245:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867467520:12345-0@lo:400:kworker.0 Request processed in 626us (7565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380346.516255:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787380346.516278:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787380346.516286:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1874203867468032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380346.516683:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3640:x1874203867468032:12345-0@lo:400:kworker.0 Request processed in 397us (8177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380346.516690:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787380346.516706:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787380346.516713:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867467648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380346.516743:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867467648:12345-0@lo:400:kworker.0 Request processed in 32us (4048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380346.517560:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787380346.518445:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867466752 00000100:00100000:3.0:1787380346.518459:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867466752 00000100:00100000:3.0:1787380346.518500:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867467264 00000100:00100000:3.0:1787380346.518504:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867467264 00000100:00100000:3.0:1787380346.518527:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867467776 00000100:00100000:3.0:1787380346.518530:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867467776 00000100:00100000:3.0:1787380346.518549:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787380346.518666:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867466752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380346.520044:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867466752:12345-0@lo:400:kworker.0 Request processed in 1482us (6906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380346.520072:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787380346.520317:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787380346.520331:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867467264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380346.520738:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867467264:12345-0@lo:400:kworker.0 Request processed in 413us (7458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380346.520745:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787380346.521043:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787380346.521051:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867467776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380346.522045:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867467776:12345-0@lo:400:kworker.0 Request processed in 991us (8713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380346.522055:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787380346.522676:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867467520:0@lo:400:kworker.0 00010000:00080000:3.0:1787380346.522693:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3c14a80 x1874203867468032/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380346.522704:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867468032:0@lo:400:kworker.0 00000100:00100000:3.0:1787380346.522741:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867467136 00000100:00100000:3.0:1787380346.522747:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867467136 00000100:00080000:2.0:1787380346.523269:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380346.523275:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787380346.523278:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787380346.523334:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867466496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 14667us (14973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380346.523466:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867468160 00000100:00100000:3.0:1787380346.523471:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867468160 00000100:00100000:3.0:1787380346.523489:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787380346.523497:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867467136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380346.523551:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867467136:12345-0@lo:400:kworker.0 Request processed in 55us (11398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380346.523557:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787380346.523629:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380346.523654:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec335bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867467392:0@lo:400:kworker.0 00000100:00100000:1.0:1787380346.523787:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867466880 00000100:00100000:1.0:1787380346.523796:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867466880 00000100:00100000:2.0:1787380346.523826:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787380346.523837:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787380346.523844:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1874203867468160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787380346.523867:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1787380346.523899:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3641:x1874203867468160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (11159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380346.523904:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787380346.523921:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787380346.523926:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867466880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380346.523953:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867466880:12345-0@lo:400:kworker.0 Request processed in 27us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380346.523959:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787380346.523988:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867467008:12345-0@lo:400:kworker.0 Request processed in 13856us (15571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380346.523995:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00010000:00080000:2.0:1787380346.524382:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5da6680 x1874203867466496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380346.524399:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867466496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380346.524413:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867467008:0@lo:400:kworker.0 00000100:00100000:2.0:1787380346.524462:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867466752:0@lo:400:kworker.0 00000100:00100000:2.0:1787380346.524475:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867467264:0@lo:400:kworker.0 00000100:00100000:2.0:1787380346.524485:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867467776:0@lo:400:kworker.0 00000100:00100000:2.0:1787380346.524494:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867466624:0@lo:400:kworker.0 00000100:00100000:2.0:1787380346.524503:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867467136:0@lo:400:kworker.0 00000100:00100000:2.0:1787380346.524513:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867467648:0@lo:400:kworker.0 00000100:00100000:2.0:1787380346.524525:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867468160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380346.524766:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380346.524787:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867467904:0@lo:400:kworker.0 00000100:00100000:0.0:1787380346.524805:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380346.524848:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867466880:0@lo:400:kworker.0 00000100:00100000:0.0:1787380346.524973:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867467392 00000100:00100000:0.0:1787380346.524977:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867467392 00000100:00100000:0.0:1787380346.525026:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867467904 00000100:00100000:0.0:1787380346.525030:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867467904 00000100:00100000:0.0:1787380346.525152:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787380346.525160:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867467392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380346.525198:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867467392:12345-0@lo:400:kworker.0 Request processed in 39us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380346.525213:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787380346.525224:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787380346.525230:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867467904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380346.525466:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867467904:12345-0@lo:400:kworker.0 Request processed in 236us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380346.525472:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1787380346.525560:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1787380346.525676:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec335bb80 x1874203867467392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380346.525687:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec335bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867467392:0@lo:400:kworker.0 00010000:00080000:1.0:1787380346.525698:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3c14000 x1874203867467904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380346.525705:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867467904:0@lo:400:kworker.0 00010000:00010000:1.0:1787380346.956316:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380347.020477:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867468288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380347.020543:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380347.021182:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867468288 00000100:00100000:2.0:1787380347.021190:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867468288 00000100:00100000:2.0:1787380347.021250:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787380347.021259:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867468288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380347.021287:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380347.021337:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867468288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380347.021344:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787380347.021367:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380347.021377:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867468416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787380347.021404:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380347.021436:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867468416 00000100:00100000:2.0:1787380347.021440:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867468416 00000100:00100000:2.0:1787380347.021462:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787380347.021468:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867468416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787380347.021494:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380347.021525:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867468416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380347.021531:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787380347.021566:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867468416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380347.021984:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867468288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380347.036533:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380347.036632:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380347.036673:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380347.036734:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848504448 00000100:00100000:0.0:1787380347.036743:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848504448 00000100:00100000:0.0:1787380347.036801:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 372 00000100:00100000:0.0:1787380347.036834:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2399:x1874203848504448:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380347.036855:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848504704 00000100:00100000:2.0:1787380347.036858:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848504704 00000100:00100000:0.0:1787380347.036900:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2399:x1874203848504448:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 91us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380347.036907:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 372 00000100:00100000:2.0:1787380347.036930:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848504576 00000100:00100000:2.0:1787380347.036933:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848504576 00000100:00100000:3.0:1787380347.036979:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 247 00000100:00100000:3.0:1787380347.036987:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848504704:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380347.037040:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848504704:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 54us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380347.037047:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 247 00000100:00080000:1.0:1787380347.037148:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787380347.037153:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787380347.037341:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 248 00000100:00100000:2.0:1787380347.037349:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848504576:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380347.037397:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848504576:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 49us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380347.037404:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 248 00000100:00100000:0.0:1787380347.067179:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380347.067257:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380347.067293:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380347.067322:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848504960 00000100:00100000:1.0:1787380347.067332:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848504960 00000100:00100000:2.0:1787380347.067380:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848505088 00000100:00100000:2.0:1787380347.067386:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848505088 00000100:00100000:3.0:1787380347.067417:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848504832 00000100:00100000:3.0:1787380347.067420:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848504832 00000100:00100000:1.0:1787380347.067526:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 249 00000100:00100000:1.0:1787380347.067537:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848504960:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380347.067615:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848504960:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 80us (357us total) trans 0 rc 0/0 00000100:00080000:0.0:1787380347.067640:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787380347.067645:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787380347.067648:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 250 00000100:00080000:0.0:1787380347.067649:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380347.067662:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848505088:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380347.067688:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 249 00000100:00100000:3.0:1787380347.068584:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 27 00000100:00100000:2.0:1787380347.068590:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848505088:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 928us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380347.068599:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2396:x1874203848504832:12345-192.168.206.30@tcp:9:kworker.0 00000100:00100000:2.0:1787380347.068603:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 250 00000020:00000080:3.0:1787380347.068625:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68f03 00000100:00080000:3.0:1787380347.068636:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9d6fff5fa800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787380347.068667:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787380347.068673:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1787380347.068794:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+2:2396:x1874203848504832:12345-192.168.206.30@tcp:9:kworker.0 Request processed in 199us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380347.068802:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 27 00010000:00010000:3.0:1787380347.979958:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380348.044146:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380348.044169:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867468544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787380348.044240:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380348.046177:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867468544 00000100:00100000:1.0:1787380348.046188:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867468544 00000100:00100000:1.0:1787380348.046258:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787380348.046278:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867468544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380348.046313:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380348.046399:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867468544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (2168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380348.046405:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787380348.046560:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867468544:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787380349.004499:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380350.029254:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380351.051888:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787380351.308581:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787380351.318859:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787380351.634943:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787380351.634963:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867468672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380351.635037:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380351.635097:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867468672 00000100:00100000:2.0:1787380351.635104:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867468672 00000100:00100000:2.0:1787380351.635149:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787380351.635157:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867468672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787380351.635181:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380351.635221:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867468672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380351.635227:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1787380351.635247:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787380351.635288:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3c14700 x1874203867468672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380351.635303:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867468672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380351.637548:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867468800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380351.637594:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380351.638895:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867468800 00000100:00100000:1.0:1787380351.638904:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867468800 00000100:00100000:1.0:1787380351.638956:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787380351.638965:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867468800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380351.638994:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380351.639044:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867468800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380351.639051:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:2.0:1787380351.639106:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787380351.639138:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3c14700 x1874203867468800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380351.639155:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867468800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380351.641314:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867468928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380351.641448:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380351.641487:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867469440:0@lo:400:kworker.0 00000100:00100000:2.0:1787380351.641509:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380351.641528:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867469952:0@lo:400:kworker.0 00000100:00100000:2.0:1787380351.641548:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380351.641569:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787380351.641587:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867469056:0@lo:400:kworker.0 00000100:00100000:2.0:1787380351.641614:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380351.641636:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867469568:0@lo:400:kworker.0 00000100:00100000:2.0:1787380351.641658:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380351.641674:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867470080:0@lo:400:kworker.0 00000100:00100000:2.0:1787380351.641692:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380351.641720:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867469440 00000100:00100000:3.0:1787380351.642223:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867469184:0@lo:400:kworker.0 00000100:00100000:3.0:1787380351.642252:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380351.642272:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867469696:0@lo:400:kworker.0 00000100:00100000:3.0:1787380351.642292:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380351.642316:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3daca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867470208:0@lo:400:kworker.0 00000100:00100000:3.0:1787380351.642340:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380351.642805:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867469440 00000100:00100000:2.0:1787380351.642849:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867469184 00000100:00100000:2.0:1787380351.642852:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867469184 00000100:00100000:2.0:1787380351.642865:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867469696 00000100:00100000:2.0:1787380351.642867:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867469696 00000100:00100000:2.0:1787380351.642885:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867470208 00000100:00100000:2.0:1787380351.642888:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867470208 00000100:00100000:2.0:1787380351.642902:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787380351.642910:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867469440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380351.642959:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867469440:12345-0@lo:400:kworker.0 Request processed in 49us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380351.642966:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787380351.642993:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787380351.642999:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867469184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380351.643025:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867469184:12345-0@lo:400:kworker.0 Request processed in 25us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380351.643031:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787380351.643041:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787380351.643046:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867469696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380351.643069:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867469696:12345-0@lo:400:kworker.0 Request processed in 23us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380351.643081:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787380351.643091:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787380351.643097:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867470208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380351.643120:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867470208:12345-0@lo:400:kworker.0 Request processed in 24us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380351.643126:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787380351.643144:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867469952 00000100:00100000:2.0:1787380351.643147:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867469952 00000100:00100000:2.0:1787380351.643170:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867470080 00000100:00100000:2.0:1787380351.643173:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867470080 00000100:00100000:2.0:1787380351.643190:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787380351.643195:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867469952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380351.643220:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867469952:12345-0@lo:400:kworker.0 Request processed in 25us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380351.643226:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787380351.643235:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787380351.643241:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867470080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380351.643264:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867470080:12345-0@lo:400:kworker.0 Request processed in 23us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380351.643270:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787380351.643285:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867468928 00000100:00100000:2.0:1787380351.643288:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867468928 00000100:00100000:2.0:1787380351.643306:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867469568 00000100:00100000:2.0:1787380351.643309:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867469568 00000100:00100000:2.0:1787380351.643320:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787380351.643325:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867468928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787380351.643354:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787380351.643526:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787380351.643540:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec335bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867469568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380351.643575:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec335bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867469568:12345-0@lo:400:kworker.0 Request processed in 37us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380351.643581:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787380351.643660:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3daca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867470208:0@lo:400:kworker.0 00000100:00100000:3.0:1787380351.643683:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867469184:0@lo:400:kworker.0 00000100:00100000:3.0:1787380351.643693:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867469696:0@lo:400:kworker.0 00000100:00100000:3.0:1787380351.643705:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1787380351.643711:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867469312:0@lo:400:kworker.0 00000100:00100000:3.0:1787380351.644471:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380351.644493:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1874203867469824:0@lo:400:kworker.0 00000100:00100000:3.0:1787380351.644516:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380351.644534:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3daf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867470336:0@lo:400:kworker.0 00000100:00100000:3.0:1787380351.644553:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380351.644580:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867469056 00000100:00100000:3.0:1787380351.644585:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867469056 00000100:00100000:3.0:1787380351.644614:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1787380351.644621:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867469056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380351.644653:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867469056:12345-0@lo:400:kworker.0 Request processed in 32us (3038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380351.644659:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1787380351.644873:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867469312 00000100:00100000:0.0:1787380351.644877:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867469312 00000100:00100000:0.0:1787380351.644895:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787380351.644901:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1874203867469312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380351.644937:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3641:x1874203867469312:12345-0@lo:400:kworker.0 Request processed in 36us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380351.644944:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787380351.645084:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867468928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1757us (3635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380351.645091:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1787380351.645121:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787380351.645126:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380351.645160:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867469056:0@lo:400:kworker.0 00000100:00100000:2.0:1787380351.645172:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867469568:0@lo:400:kworker.0 00000100:00100000:2.0:1787380351.645182:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867470080:0@lo:400:kworker.0 00000100:00100000:2.0:1787380351.645197:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867468928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380351.645209:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867469440:0@lo:400:kworker.0 00000100:00100000:2.0:1787380351.645220:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867469952:0@lo:400:kworker.0 00000100:00100000:2.0:1787380351.647829:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867469824 00000100:00100000:2.0:1787380351.647840:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867469824 00000100:00100000:2.0:1787380351.647883:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867470336 00000100:00100000:2.0:1787380351.647886:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867470336 00000100:00100000:2.0:1787380351.647904:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787380351.647913:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874203867469824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380351.647992:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874203867469824:12345-0@lo:400:kworker.0 Request processed in 80us (3474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380351.648000:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787380351.648016:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787380351.648021:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874203867470336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380351.648048:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874203867470336:12345-0@lo:400:kworker.0 Request processed in 27us (3494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380351.648061:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:2.0:1787380351.648103:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787380351.652995:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867469312:0@lo:400:kworker.0 00010000:00080000:3.0:1787380351.653019:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec34ed880 x1874203867469824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380351.653031:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1874203867469824:0@lo:400:kworker.0 00010000:00080000:3.0:1787380351.653061:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3daf100 x1874203867470336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380351.653070:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3daf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867470336:0@lo:400:kworker.0 00010000:00010000:2.0:1787380352.076107:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380352.141252:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380352.141273:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867470464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380352.141339:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380352.141664:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380352.141674:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867470592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380352.141703:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380352.142563:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867470464 00000100:00100000:2.0:1787380352.142571:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867470464 00000100:00100000:2.0:1787380352.142610:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867470592 00000100:00100000:2.0:1787380352.142613:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867470592 00000100:00100000:2.0:1787380352.142704:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787380352.142713:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867470464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380352.144059:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380352.144127:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867470464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1414us (2786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380352.144135:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787380352.147424:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787380352.147446:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867470592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787380352.147473:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380352.147539:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867470592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (5835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380352.147547:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787380352.147612:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867470464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380352.168996:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380352.169049:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380352.169079:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380352.169105:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380352.169127:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380352.169150:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848505344 00000100:00100000:1.0:1787380352.169159:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848505344 00000100:00100000:1.0:1787380352.169203:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848505600 00000100:00100000:1.0:1787380352.169206:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848505600 00000100:00100000:1.0:1787380352.169220:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848505472 00000100:00100000:1.0:1787380352.169222:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848505472 00000100:00100000:1.0:1787380352.169233:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848505728 00000100:00100000:1.0:1787380352.169236:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848505728 00000100:00100000:1.0:1787380352.169253:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 257 00000100:00100000:3.0:1787380352.169646:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 258 00000100:00100000:1.0:1787380352.169671:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2397:x1874203848505344:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380352.169752:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2397:x1874203848505344:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 491us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380352.169760:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 257 00000100:00100000:1.0:1787380352.169779:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 259 00000100:00100000:1.0:1787380352.169786:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2397:x1874203848505472:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380352.169832:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2397:x1874203848505472:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 46us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380352.169839:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 259 00000100:00100000:1.0:1787380352.169851:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 260 00000100:00100000:1.0:1787380352.169857:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848505728:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380352.169879:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848505728:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 23us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380352.169885:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 260 00000100:00080000:1.0:1787380352.169927:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787380352.169931:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380352.170081:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848505216 00000100:00100000:0.0:1787380352.170086:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848505216 00000100:00100000:0.0:1787380352.170116:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 374 00000100:00100000:0.0:1787380352.170123:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2397:x1874203848505216:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380352.170148:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2397:x1874203848505216:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 26us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380352.170154:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 374 00000100:00100000:0.0:1787380352.170218:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867470592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380352.176579:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848505600:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380352.180397:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848505600:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 10732us (11336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380352.180411:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 258 00000001:00100000:2.0:1787380352.657484:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000020:00000080:2.0:1787380352.657493:0:8429:0:(genops.c:906:class_export_put()) final put ffff9d6fff5fc800/7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000020:00000080:0.0:1787380352.660850:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fff5fc800/7da54272-8859-4cb3-ba98-d1d4e18c7c38 for lustre-OST0000 00000020:00000080:0.0:1787380352.660911:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6fff5fa800 for lustre-OST0000 00010000:00010000:2.0:1787380353.106890:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380353.169525:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787380353.169544:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867470720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787380353.169602:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380353.169650:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867470720 00000100:00100000:1.0:1787380353.169657:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867470720 00000100:00100000:1.0:1787380353.169694:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787380353.169701:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867470720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380353.169741:0:13003:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380353.169778:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867470720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380353.169785:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787380353.170036:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867470720:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787380354.126357:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380355.148015:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787380356.126363:0:14065:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 02:32:35 (1787380355) 00010000:00010000:1.0:1787380356.176962:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380356.748244:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867471232:0@lo:400:kworker.0 00000100:00100000:0.0:1787380356.748333:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380356.748412:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867471744:0@lo:400:kworker.0 00000100:00100000:0.0:1787380356.748446:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380356.748463:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867472256:0@lo:400:kworker.0 00000100:00100000:0.0:1787380356.748484:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380356.748535:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1787380356.748542:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867470848:0@lo:400:kworker.0 00000100:00100000:0.0:1787380356.748570:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380356.748590:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867471360:0@lo:400:kworker.0 00000100:00100000:0.0:1787380356.748612:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380356.748627:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867471872:0@lo:400:kworker.0 00000100:00100000:0.0:1787380356.748645:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380356.748659:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867472384:0@lo:400:kworker.0 00000100:00100000:0.0:1787380356.748680:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380356.749073:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867471232 00000100:00100000:3.0:1787380356.749080:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867471232 00000100:00100000:3.0:1787380356.749138:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787380356.749147:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867471232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380356.749220:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867471232:12345-0@lo:400:kworker.0 Request processed in 74us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380356.749234:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787380356.749266:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867471744 00000100:00100000:3.0:1787380356.749270:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867471744 00000100:00100000:3.0:1787380356.749308:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867472256 00000100:00100000:3.0:1787380356.749311:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867472256 00000100:00100000:3.0:1787380356.749325:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867471872 00000100:00100000:3.0:1787380356.749327:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867471872 00000100:00100000:3.0:1787380356.749337:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867472384 00000100:00100000:3.0:1787380356.749340:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867472384 00000100:00100000:3.0:1787380356.749351:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787380356.749356:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867471744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380356.749387:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867471744:12345-0@lo:400:kworker.0 Request processed in 30us (940us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380356.749404:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787380356.749418:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787380356.749424:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867472256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380356.749453:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867472256:12345-0@lo:400:kworker.0 Request processed in 30us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380356.749459:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787380356.749471:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787380356.749476:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867471872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380356.749526:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867471872:12345-0@lo:400:kworker.0 Request processed in 40us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380356.749533:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787380356.749545:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787380356.749551:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867472384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380356.749578:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867472384:12345-0@lo:400:kworker.0 Request processed in 27us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380356.749583:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787380356.749602:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867470848 00000100:00100000:3.0:1787380356.749605:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867470848 00000100:00100000:3.0:1787380356.749630:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1787380356.749636:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867470848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380356.749664:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867470848:12345-0@lo:400:kworker.0 Request processed in 28us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380356.749669:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1787380356.749716:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867470848:0@lo:400:kworker.0 00000100:00100000:3.0:1787380356.749741:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867471872:0@lo:400:kworker.0 00010000:00080000:3.0:1787380356.749752:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff3fc3100 x1874203867472384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380356.749762:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867472384:0@lo:400:kworker.0 00000100:00100000:3.0:1787380356.749772:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867471232:0@lo:400:kworker.0 00000100:00100000:3.0:1787380356.749780:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867471744:0@lo:400:kworker.0 00010000:00080000:3.0:1787380356.749789:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff3fc3800 x1874203867472256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380356.749796:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867472256:0@lo:400:kworker.0 00000100:00080000:1.0:1787380356.751773:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787380356.751784:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380356.752865:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867470976:0@lo:400:kworker.0 00000100:00100000:2.0:1787380356.753061:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380356.753099:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867471488:0@lo:400:kworker.0 00000100:00100000:2.0:1787380356.753123:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380356.753141:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3daca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867472000:0@lo:400:kworker.0 00000100:00100000:2.0:1787380356.753174:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380356.753199:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787380356.753207:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867471104:0@lo:400:kworker.0 00000100:00100000:2.0:1787380356.753242:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380356.753261:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3daf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867471616:0@lo:400:kworker.0 00000100:00100000:2.0:1787380356.753282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380356.753293:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867472128:0@lo:400:kworker.0 00000100:00100000:2.0:1787380356.753605:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380356.753649:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867471360 00000100:00100000:2.0:1787380356.753657:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867471360 00000100:00100000:2.0:1787380356.753706:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867471104 00000100:00100000:2.0:1787380356.753709:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867471104 00000100:00100000:2.0:1787380356.753726:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787380356.753733:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867471360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380356.753790:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867471360:12345-0@lo:400:kworker.0 Request processed in 56us (5175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380356.753798:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787380356.753840:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787380356.753848:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867471104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380356.755000:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380356.755018:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867472512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787380356.755064:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380356.755135:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867470976 00000100:00100000:1.0:1787380356.755141:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867470976 00000100:00100000:1.0:1787380356.755168:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867471488 00000100:00100000:1.0:1787380356.755171:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867471488 00000100:00100000:1.0:1787380356.755191:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867472000 00000100:00100000:1.0:1787380356.755194:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867472000 00000100:00100000:1.0:1787380356.755205:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867471616 00000100:00100000:1.0:1787380356.755219:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867471616 00000100:00100000:1.0:1787380356.755245:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867472128 00000100:00100000:1.0:1787380356.755248:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867472128 00000100:00100000:1.0:1787380356.755262:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787380356.755269:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867470976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380356.755397:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787380356.755405:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867471488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380356.755618:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867472640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380356.762756:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867471488:12345-0@lo:400:kworker.0 Request processed in 7342us (9621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380356.762771:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787380356.762822:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787380356.762835:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867472000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380356.762901:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867472000:12345-0@lo:400:kworker.0 Request processed in 60us (9727us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380356.762908:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787380356.762954:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787380356.762962:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867471616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380356.762995:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867471616:12345-0@lo:400:kworker.0 Request processed in 34us (9712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380356.763001:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787380356.763014:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787380356.763021:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867472128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380356.763052:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2607800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867472128:12345-0@lo:400:kworker.0 Request processed in 31us (9447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380356.763058:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1787380356.763179:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787380356.763185:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380356.763197:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380356.763210:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867472768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380356.763262:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380356.763310:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867472512 00000100:00100000:0.0:1787380356.763317:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867472512 00000100:00100000:0.0:1787380356.763343:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787380356.763350:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1874203867472512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787380356.763376:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1787380356.763411:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3640:x1874203867472512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (8347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380356.763418:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00010000:00080000:0.0:1787380356.763457:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3daf100 x1874203867471616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380356.763472:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3daf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867471616:0@lo:400:kworker.0 00010000:00080000:0.0:1787380356.763508:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff3fc1f80 x1874203867472128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380356.763517:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867472128:0@lo:400:kworker.0 00000100:00100000:0.0:1787380356.763532:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867471488:0@lo:400:kworker.0 00000100:00100000:0.0:1787380356.763542:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3daca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867472000:0@lo:400:kworker.0 00000100:00100000:0.0:1787380356.763578:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867471360:0@lo:400:kworker.0 00000100:00100000:0.0:1787380356.763605:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867472768 00000100:00100000:0.0:1787380356.763608:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867472768 00000100:00100000:0.0:1787380356.763634:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787380356.763641:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867472768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787380356.763658:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380356.763693:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867472768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380356.763699:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:0.0:1787380356.763724:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec336fb80 x1874203867472768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380356.763736:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867472768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787380356.764176:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380356.764215:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867472512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380356.768876:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867472640 00000100:00100000:0.0:1787380356.768891:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867472640 00000100:00100000:0.0:1787380356.768964:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787380356.768975:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867472640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787380356.769004:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380356.769094:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867472640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (4918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380356.769116:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:3.0:1787380356.769261:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff3fc3800 x1874203867472640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380356.769282:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867472640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787380356.778726:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867470976:12345-0@lo:400:kworker.0 Request processed in 23448us (25657us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380356.778740:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787380356.779019:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867470976:0@lo:400:kworker.0 00000100:00100000:3.0:1787380356.791532:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867471104:12345-0@lo:400:kworker.0 Request processed in 37669us (38273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380356.791548:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787380356.797255:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867471104:0@lo:400:kworker.0 00010000:00010000:0.0:1787380357.195992:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380357.260089:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380357.260113:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec2604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867472896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380357.260189:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380357.260312:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867472896 00000100:00100000:0.0:1787380357.260319:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867472896 00000100:00100000:0.0:1787380357.260363:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787380357.260372:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867472896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380357.260408:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380357.260468:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867472896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380357.260475:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787380357.261373:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec2604a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867472896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380357.261683:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5dc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867473024:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380357.261720:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380357.261825:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867473024 00000100:00100000:1.0:1787380357.261830:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867473024 00000100:00100000:1.0:1787380357.261864:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1787380357.261872:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867473024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787380357.261886:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380357.261932:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867473024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380357.261939:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787380357.262006:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5dc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867473024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787380357.286902:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380357.286951:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380357.286985:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380357.287015:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380357.287038:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380357.287074:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848506112 00000100:00100000:1.0:1787380357.287082:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848506112 00000100:00100000:1.0:1787380357.287126:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848506368 00000100:00100000:1.0:1787380357.287129:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848506368 00000100:00100000:1.0:1787380357.287142:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848505984 00000100:00100000:1.0:1787380357.287144:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848505984 00000100:00100000:1.0:1787380357.287154:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848506240 00000100:00100000:1.0:1787380357.287156:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848506240 00000100:00100000:1.0:1787380357.287186:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 267 00000100:00100000:1.0:1787380357.287193:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848506112:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380357.287259:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848506112:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 66us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380357.287266:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 267 00000100:00100000:1.0:1787380357.287362:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 268 00000100:00100000:1.0:1787380357.287370:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848506368:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380357.287397:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5dc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848506368:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 28us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380357.287410:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 268 00000100:00100000:1.0:1787380357.287422:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 269 00000100:00100000:1.0:1787380357.287429:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848505984:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380357.287454:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848505984:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 26us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380357.287460:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 269 00000100:00100000:1.0:1787380357.287473:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 270 00000100:00100000:1.0:1787380357.287479:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848506240:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380357.287501:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848506240:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 22us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380357.287507:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 270 00000100:00100000:0.0:1787380357.287609:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848505856 00000100:00100000:0.0:1787380357.287614:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848505856 00000100:00100000:0.0:1787380357.287639:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 376 00000100:00100000:0.0:1787380357.287646:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3f4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2400:x1874203848505856:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380357.287670:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3f4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2400:x1874203848505856:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 25us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380357.287677:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 376 00000100:00080000:0.0:1787380357.287745:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787380357.287748:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787380358.018404:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380358.018615:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848506496 00000100:00100000:1.0:1787380358.018625:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848506496 00000100:00100000:1.0:1787380358.018680:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 40 00000100:00100000:1.0:1787380358.018689:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:11065:x1874203848506496:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787380358.018723:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380358.018743:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ba00/0xcf3c46fdcad68fe3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac2c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380358.018800:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad68fea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380358.018854:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad68fea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380358.018867:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad68fea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380358.018921:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787380358.018925:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787380358.018967:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad68fea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380358.018991:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ba00/0xcf3c46fdcad68fe3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac2c expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380358.019008:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad68fea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac2c expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380358.019015:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec3030e00) 00010000:00010000:1.0:1787380358.019019:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787380358.019021:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc165ac00, rc 0) 00000100:00100000:1.0:1787380358.019081:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:11065:x1874203848506496:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 393us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380358.019089:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 40 00000100:00100000:0.0:1787380358.027014:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380358.027158:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848506624 00000100:00100000:3.0:1787380358.027168:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848506624 00000100:00100000:3.0:1787380358.027227:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 41 00000100:00100000:3.0:1787380358.027238:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:11066:x1874203848506624:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380358.027268:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380358.027287:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad68ff1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac33 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027347:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ff8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027362:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ff8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027372:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ff8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027387:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad68fff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027395:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad68fff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027401:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad68fff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027471:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb000/0xcf3c46fdcad69006 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027496:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb000/0xcf3c46fdcad69006 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027504:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb000/0xcf3c46fdcad69006 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380358.027541:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787380358.027545:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787380358.027566:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb000/0xcf3c46fdcad69006 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027576:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ff8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027583:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ff8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027590:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ff8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027595:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdba00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380358.027600:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ff8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027607:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ff8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027618:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec3030e00) 00010000:00010000:3.0:1787380358.027621:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380358.027626:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ff8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027643:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad68ff8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027659:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad68fff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027666:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad68fff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027672:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad68fff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027677:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdaa00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380358.027680:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad68fff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027686:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad68fff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027694:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9d6ec241b400) 00010000:00010000:3.0:1787380358.027697:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380358.027699:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad68fff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027704:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad68fff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027740:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad68ff1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac33 expref: 8 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027753:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb000/0xcf3c46fdcad69006 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac33 expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380358.027766:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d6ec241b500) 00010000:00010000:3.0:1787380358.027768:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787380358.027771:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fdb000, rc 0) 00000100:00100000:3.0:1787380358.027899:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:11066:x1874203848506624:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 662us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380358.027907:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 41 00000100:00100000:2.0:1787380358.037924:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380358.038895:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848506752 00000100:00100000:3.0:1787380358.038905:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848506752 00000100:00100000:3.0:1787380358.038971:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:3.0:1787380358.038980:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec2604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:11066:x1874203848506752:12345-192.168.206.30@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787380358.039054:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec2604a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:11066:x1874203848506752:12345-192.168.206.30@tcp:900:lhsmtool_posix.0 Request processed in 75us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380358.039061:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:1.0:1787380358.067882:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380358.068130:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848507008 00000100:00100000:2.0:1787380358.068140:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848507008 00000100:00100000:2.0:1787380358.068200:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00100000:2.0:1787380358.068209:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:11066:x1874203848507008:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380358.068227:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380358.068244:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6900d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac3a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068304:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad69014 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068316:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad69014 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068327:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad69014 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068386:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6901b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068394:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6901b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068400:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6901b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068522:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47800/0xcf3c46fdcad69022 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068531:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47800/0xcf3c46fdcad69022 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068554:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47800/0xcf3c46fdcad69022 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380358.068565:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787380358.068653:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad69014 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068661:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad69014 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068668:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad69014 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068794:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380358.068799:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad69014 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068840:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad69014 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068853:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d6ec241b500) 00010000:00010000:2.0:1787380358.068857:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380358.068861:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad69014 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068868:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad69014 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068882:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6901b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068888:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6901b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068901:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6901b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068906:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46c00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380358.068909:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6901b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068915:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6901b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068923:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d6ec25a8100) 00010000:00010000:2.0:1787380358.068925:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380358.068928:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6901b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.068934:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6901b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.069213:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6900d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac3a expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.069228:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47800/0xcf3c46fdcad69022 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac3a expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380358.069234:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6ec25a8300) 00010000:00010000:2.0:1787380358.069236:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380358.069239:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d47800, rc 0) 00000100:00100000:2.0:1787380358.069304:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:11066:x1874203848507008:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 1095us (1431us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787380358.069323:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00100000:0.0:1787380358.073903:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380358.073997:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848507136 00000100:00100000:2.0:1787380358.074006:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848507136 00000100:00100000:2.0:1787380358.074063:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 43 00000100:00100000:2.0:1787380358.074071:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:11066:x1874203848507136:12345-192.168.206.30@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787380358.074170:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:11066:x1874203848507136:12345-192.168.206.30@tcp:59:lhsmtool_posix.0 Request processed in 99us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380358.074177:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 43 00000100:00100000:1.0:1787380358.082881:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380358.083007:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848507264 00000100:00100000:0.0:1787380358.083030:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848507264 00000100:00100000:0.0:1787380358.083093:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 44 00000100:00100000:0.0:1787380358.083103:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:11066:x1874203848507264:12345-192.168.206.30@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1787380358.085359:0:6522:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2211us 00000100:00100000:0.0:1787380358.105907:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:11066:x1874203848507264:12345-192.168.206.30@tcp:59:lhsmtool_posix.0 Request processed in 22796us (23025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380358.105922:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 44 00010000:00010000:1.0:1787380358.221861:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380358.284574:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec36d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867473152:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787380358.284637:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380358.284799:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867473152 00000100:00100000:1.0:1787380358.284835:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867473152 00000100:00100000:1.0:1787380358.284881:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787380358.284901:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867473152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380358.284934:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380358.284989:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867473152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380358.284996:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787380358.290545:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec36d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867473152:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1787380358.479297:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787380358.482299:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787380359.245034:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380360.068101:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380360.068186:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848507392 00000100:00100000:3.0:1787380360.068195:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848507392 00000100:00100000:3.0:1787380360.068263:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 45 00000100:00100000:3.0:1787380360.068273:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec36d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:11108:x1874203848507392:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1787380360.068293:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380360.068311:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69030 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac41 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068394:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69037 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068409:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69037 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068421:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69037 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068437:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad6903e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068444:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad6903e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068451:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad6903e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068486:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69037 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068494:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69037 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068500:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69037 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068505:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdaa00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380360.068510:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69037 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068528:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69037 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068540:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec3030e00) 00010000:00010000:3.0:1787380360.068543:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380360.068548:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69037 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068555:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69037 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068567:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad6903e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068572:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad6903e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068578:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad6903e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068584:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdba00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380360.068586:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad6903e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068592:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad6903e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068599:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d6ec241b400) 00010000:00010000:3.0:1787380360.068602:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380360.068604:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad6903e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068620:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad6903e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068662:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69030 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac41 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068672:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec3030e00) 00010000:00010000:3.0:1787380360.068675:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380360.068679:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69030 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac41 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.068687:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fda600, rc 0) 00000100:00100000:3.0:1787380360.068748:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec36d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:11108:x1874203848507392:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 475us (655us total) trans 0 rc 301/301 00000100:00100000:3.0:1787380360.068754:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 45 00000100:00080000:0.0:1787380360.068843:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380360.073668:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380360.074006:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848507648 00000100:00100000:2.0:1787380360.074015:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848507648 00000100:00100000:2.0:1787380360.074062:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 46 00000100:00100000:2.0:1787380360.074072:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:11108:x1874203848507648:12345-192.168.206.30@tcp:36:lfs.0 00010000:00010000:2.0:1787380360.074127:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380360.074152:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad68fea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac2c expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.074172:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec3030e00) 00010000:00010000:2.0:1787380360.074182:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380360.074242:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad69045 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.074256:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad69045 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.074266:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad69045 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.074295:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6904c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.074303:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6904c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.074309:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6904c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.074788:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad69053 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.074797:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad69053 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.074805:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad69053 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380360.074851:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000acc60afb reply state 00000000687cf8ec transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad69053 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.074861:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad69053 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.074868:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:2.0:1787380360.074871:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787380360.074873:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787380360.074877:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787380360.075275:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad69045 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.075283:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad69045 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.075298:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad69045 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.075304:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46c00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380360.075308:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad69045 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.075315:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad69045 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.075325:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25aa200) 00010000:00010000:2.0:1787380360.075328:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380360.075331:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad69045 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.075338:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad69045 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380360.075353:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000acc60afb reply state 00000000687cf8ec transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6904c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.075362:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6904c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.075368:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d6ec25aa500) 00010000:00010000:2.0:1787380360.075370:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787380360.075372:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1787380360.075462:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+10:11108:x1874203848507648:12345-192.168.206.30@tcp:36:lfs.0 Request processed in 1390us (1800us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787380360.075470:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 46 00000100:00100000:1.0:1787380360.152595:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380360.152855:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848507776 00000100:00100000:3.0:1787380360.152864:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848507776 00000100:00100000:3.0:1787380360.153011:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 47 00000100:00100000:3.0:1787380360.153022:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+10:11116:x1874203848507776:12345-192.168.206.30@tcp:101:lctl.0 00010000:00010000:3.0:1787380360.153043:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380360.153069:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad6905a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac48 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.153127:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad69061 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.153138:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad69061 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.153161:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad69061 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380360.153200:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787380360.153203:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787380360.153232:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad69061 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.153254:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad6905a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac48 expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.153269:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad69061 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac48 expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.153277:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec241b400) 00010000:00010000:3.0:1787380360.153280:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787380360.153283:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fdba00, rc 0) 00000100:00100000:3.0:1787380360.153332:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+11:11116:x1874203848507776:12345-192.168.206.30@tcp:101:lctl.0 Request processed in 312us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380360.153339:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 47 00000100:00100000:1.0:1787380360.235777:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380360.236096:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848507904 00000100:00100000:0.0:1787380360.236106:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848507904 00000100:00100000:0.0:1787380360.236158:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 48 00000100:00100000:0.0:1787380360.236168:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+11:11122:x1874203848507904:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1787380360.236187:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380360.236206:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69068 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac4f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236425:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6906f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236441:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6906f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236452:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6906f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236463:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69076 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236548:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236571:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236645:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867200/0xcf3c46fdcad6907d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236654:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867200/0xcf3c46fdcad6907d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236661:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867200/0xcf3c46fdcad6907d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380360.236694:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787380360.236699:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787380360.236736:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867200/0xcf3c46fdcad6907d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236749:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6906f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236756:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6906f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236763:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6906f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236769:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867c00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380360.236774:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6906f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236780:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6906f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236802:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec241b400) 00010000:00010000:0.0:1787380360.236804:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380360.236834:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6906f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236840:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6906f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236852:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236857:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69076 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236862:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69076 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236866:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380360.236869:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69076 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236874:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69076 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236880:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d6ec25aa500) 00010000:00010000:0.0:1787380360.236882:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380360.236885:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69076 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236891:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69076 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236943:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69068 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac4f expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236957:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867200/0xcf3c46fdcad6907d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac4f expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.236964:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:0.0:1787380360.236966:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787380360.236968:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867200, rc 0) 00000100:00100000:0.0:1787380360.237032:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+12:11122:x1874203848507904:12345-192.168.206.30@tcp:101:bash.0 Request processed in 865us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380360.237039:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 48 00000100:00100000:0.0:1787380360.240157:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380360.240265:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848508160 00000100:00100000:2.0:1787380360.240274:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848508160 00000100:00100000:2.0:1787380360.240416:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 49 00000100:00100000:2.0:1787380360.240427:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+12:11122:x1874203848508160:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:2.0:1787380360.240449:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380360.240478:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad69084 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac56 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.240581:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6908b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.240594:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6908b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.240605:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6908b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.240660:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad69092 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.240668:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad69092 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.240674:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad69092 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787380360.241241:0:10154:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787380360.241802:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad69099 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.242445:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad69099 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.242595:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad69099 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.242641:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6908b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.242649:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6908b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.242655:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6908b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.242660:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380360.242664:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6908b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.242671:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6908b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.244213:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:2.0:1787380360.244220:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380360.244226:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6908b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.244234:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6908b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380360.244253:0:10154:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f58c2457 reply state 00000000dd597663 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad69092 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.244265:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad69092 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.244287:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec25aa200) 00010000:00010000:2.0:1787380360.244290:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787380360.244293:0:10154:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787380360.244776:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad69084 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac56 expref: 15 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.244793:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad69099 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac56 expref: 14 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.244800:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:2.0:1787380360.244803:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380360.244805:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46200, rc 0) 00000100:00100000:2.0:1787380360.244888:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+15:11122:x1874203848508160:12345-192.168.206.30@tcp:101:bash.0 Request processed in 4463us (4738us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787380360.244896:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 49 00000100:00100000:1.0:1787380360.250136:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380360.250265:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848508288 00000100:00100000:3.0:1787380360.250274:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848508288 00000100:00100000:3.0:1787380360.250604:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 28 00000100:00100000:3.0:1787380360.250614:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2396:x1874203848508288:12345-192.168.206.30@tcp:8:bash.0 00010000:00080000:3.0:1787380360.250648:0:8436:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp t0 exp 0000000000000000 cur 370 last 0 00000020:00000080:3.0:1787380360.250692:0:8436:0:(genops.c:1406:class_connect()) connect: client 7da54272-8859-4cb3-ba98-d1d4e18c7c38, cookie 0xcf3c46fdcad690a7 00002000:00100000:3.0:1787380360.250705:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7da54272-8859-4cb3-ba98-d1d4e18c7c38/ffff9d6fd2f4f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787380360.250729:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787380360.250844:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787380360.250872:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9d6fd2f4d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787380360.250942:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2396:x1874203848508288:12345-192.168.206.30@tcp:8:bash.0 Request processed in 327us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380360.250950:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 28 00000100:00100000:1.0:1787380360.253624:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380360.253956:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848508416 00000100:00100000:0.0:1787380360.253967:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848508416 00000100:00100000:0.0:1787380360.254129:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 29 00000100:00100000:0.0:1787380360.254139:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:0:x1874203848508416:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1787380360.254154:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380360.254175:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003355c1a5/0xcf3c46fdcad690ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac5d expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380360.254198:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380360.254216:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=370s v=(0 0) 00010000:00010000:0.0:1787380360.254220:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380360.254229:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003355c1a5/0xcf3c46fdcad690ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac5d expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.254267:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003355c1a5/0xcf3c46fdcad690ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac5d expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.254278:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867600, rc 0) 00000100:00100000:0.0:1787380360.254330:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:0:x1874203848508416:12345-192.168.206.30@tcp:101:bash.0 Request processed in 194us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380360.254338:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 29 00000100:00080000:2.0:1787380360.254369:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787380360.258048:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380360.258154:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848508544 00000100:00100000:2.0:1787380360.258164:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848508544 00000100:00100000:2.0:1787380360.258220:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 30 00000100:00100000:2.0:1787380360.258229:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:11122:x1874203848508544:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:2.0:1787380360.258247:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380360.258267:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad690b5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac64 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.258352:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003355c1a5/0xcf3c46fdcad690ae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac5d expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.258377:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380360.258381:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380360.258387:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad690b5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac64 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.258421:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003355c1a5/0xcf3c46fdcad690ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac5d expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.258435:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003355c1a5/0xcf3c46fdcad690ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac5d expref: 8 pid: 8435 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380360.258448:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1874203867473280:192.168.206.30@tcp:104: 00000100:00100000:2.0:1787380360.258546:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380360.261768:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1874203867473280:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380360.261803:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad690b5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac64 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.261858:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46c00, rc 0) 00000100:00100000:2.0:1787380360.261917:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:11122:x1874203848508544:12345-192.168.206.30@tcp:101:bash.0 Request processed in 3688us (3876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380360.261938:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 30 00000100:00100000:1.0:1787380360.262135:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380360.262347:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848508672 00000100:00100000:2.0:1787380360.262354:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848508672 00010000:00010000:2.0:1787380360.262615:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003355c1a5/0xcf3c46fdcad690ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac5d expref: 8 pid: 8435 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380360.262664:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 52 00000100:00100000:2.0:1787380360.262674:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd68ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2400:x1874203848508672:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380360.262697:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380360.262717:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003355c1a5/0xcf3c46fdcad690ae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac5d expref: 8 pid: 8435 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.262729:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003355c1a5/0xcf3c46fdcad690ae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac5d expref: 8 pid: 8435 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.262758:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003355c1a5/0xcf3c46fdcad690ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac5d expref: 8 pid: 8435 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.262775:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380360.262779:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380360.262786:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad690b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac64 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.262797:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad690b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac64 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.262878:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad690b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac64 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380360.262893:0:6507:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6507:1874203867473408:192.168.206.30@tcp:105: 00000100:00100000:2.0:1787380360.262975:0:6507:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380360.265216:0:6507:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3ff8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6507:1874203867473408:192.168.206.30@tcp:105: 00010000:00010000:2.0:1787380360.265243:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380360.265437:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd68ce850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2400:x1874203848508672:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 2763us (3301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380360.265447:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 52 00000100:00100000:3.0:1787380360.266204:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380360.266365:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848508928 00000100:00100000:0.0:1787380360.266445:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848508928 00000100:00100000:0.0:1787380360.266500:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:0.0:1787380360.266509:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+15:11122:x1874203848508928:12345-192.168.206.30@tcp:35:bash.0 00000100:00100000:0.0:1787380360.266789:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+16:11122:x1874203848508928:12345-192.168.206.30@tcp:35:bash.0 Request processed in 280us (586us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787380360.266796:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 6 00010000:00010000:0.0:1787380360.268360:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380360.335136:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380360.335211:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848509184 00000100:00100000:2.0:1787380360.335220:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848509184 00000100:00100000:2.0:1787380360.335278:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 50 00000100:00100000:2.0:1787380360.335289:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+16:11132:x1874203848509184:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1787380360.335311:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380360.335439:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad690bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac6b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380360.335759:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787380360.335888:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad690bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac6b expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.335903:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec241b400) 00010000:00010000:2.0:1787380360.335906:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787380360.335911:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad690bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac6b expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.335935:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46800, rc 0) 00000100:00100000:2.0:1787380360.335993:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+17:11132:x1874203848509184:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 705us (865us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1787380360.336000:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 50 00000100:00100000:2.0:1787380360.338794:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380360.338957:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848509440 00000100:00100000:1.0:1787380360.338966:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848509440 00000100:00100000:1.0:1787380360.339022:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:1.0:1787380360.339032:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+17:11132:x1874203848509440:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:1.0:1787380360.339267:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:11132:x1874203848509440:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 237us (479us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787380360.339276:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:3.0:1787380360.400209:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380360.400375:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848509568 00000100:00100000:0.0:1787380360.400385:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848509568 00000100:00100000:0.0:1787380360.400498:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 51 00000100:00100000:0.0:1787380360.400509:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:11138:x1874203848509568:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1787380360.400530:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380360.400547:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad690ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac72 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.400621:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad690d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.400633:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad690d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.400644:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad690d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380360.400683:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787380360.400686:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787380360.400703:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad690d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.400725:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad690ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac72 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.400742:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad690d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac72 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.400750:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:0.0:1787380360.400753:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787380360.400756:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866400, rc 0) 00000100:00100000:0.0:1787380360.400881:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:11138:x1874203848509568:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 373us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380360.400888:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 51 00000100:00100000:0.0:1787380360.406704:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380360.407340:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848509824 00000100:00100000:2.0:1787380360.407350:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848509824 00000100:00100000:2.0:1787380360.407969:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 52 00000100:00100000:2.0:1787380360.407981:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:11138:x1874203848509824:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1787380360.407999:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380360.408019:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad690d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac79 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.408135:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad690df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.408149:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad690df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.408160:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad690df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380360.408173:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787380360.408287:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad690d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac79 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.408304:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad690df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac79 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.408325:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:2.0:1787380360.408328:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380360.408331:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0e400, rc 0) 00000100:00100000:2.0:1787380360.408383:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+21:11138:x1874203848509824:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 406us (1688us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787380360.408397:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 52 00000100:00100000:1.0:1787380360.413892:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380360.413964:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380360.414304:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848510080 00000100:00100000:2.0:1787380360.414402:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848510080 00000100:00100000:2.0:1787380360.414502:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 53 00000100:00100000:2.0:1787380360.414513:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+21:11138:x1874203848510080:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1787380360.414543:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380360.414561:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad690ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac80 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.414647:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad690f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.414661:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad690f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.414671:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad690f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380360.414693:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787380360.414785:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad690ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac80 expref: 24 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.414801:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad690f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac80 expref: 23 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.414829:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:2.0:1787380360.414832:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787380360.414836:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0e000, rc 0) 00000100:00100000:2.0:1787380360.414901:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+23:11138:x1874203848510080:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 390us (1016us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787380360.414909:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 53 00000100:00100000:3.0:1787380360.416224:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848510208 00000100:00100000:3.0:1787380360.416233:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848510208 00000100:00100000:3.0:1787380360.416402:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:3.0:1787380360.416411:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+23:2397:x1874203848510208:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380360.416422:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380360.416440:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad690df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac79 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.416457:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:3.0:1787380360.416461:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380360.416655:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:2397:x1874203848510208:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 190us (2635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380360.416665:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:1.0:1787380360.428195:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380360.429342:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848510336 00000100:00100000:3.0:1787380360.429355:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848510336 00000100:00100000:3.0:1787380360.429427:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 31 00000100:00100000:3.0:1787380360.429437:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2399:x1874203848510336:12345-192.168.206.30@tcp:1:lfs.0 00010000:00010000:3.0:1787380360.429484:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000872f6040/0xcf3c46fdcad69102 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.429516:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad690b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac64 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.429523:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380360.429527:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787380360.429531:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000872f6040/0xcf3c46fdcad69102 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.429574:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad690b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac64 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.429589:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad690b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac64 expref: 7 pid: 8433 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380360.429603:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4f20700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1874203867473536:192.168.206.30@tcp:104: 00000100:00100000:3.0:1787380360.429701:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec27790c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380360.439579:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380360.441140:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848510464 00000100:00100000:0.0:1787380360.441173:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848510464 00002000:00100000:0.0:1787380360.441230:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9d6ff3ff8e00 x1874203848510464/t0(0) o4->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:166/0 lens 504/0 e 0 to 0 dl 1787380371 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380360.441241:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ff3ff8e00 with x1874203848510464 ext(0->12) 00010000:00010000:0.0:1787380360.441250:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad690b5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac64 expref: 8 pid: 8433 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.441264:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad690b5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac64 expref: 8 pid: 8433 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380360.441272:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d6ff3ff8e00 00000100:00100000:0.0:1787380360.441306:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:0.0:1787380360.441327:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2400:x1874203848510464:12345-192.168.206.30@tcp:4:lfs.0 00000001:00100000:2.0:1787380360.443309:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000100:00100000:0.0:1787380360.444014:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:2400:x1874203848510464:12345-192.168.206.30@tcp:4:lfs.0 Request processed in 2683us (4438us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787380360.444038:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 0 00002000:00100000:0.0:1787380360.444050:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9d6ff3ff8e00 x1874203848510464/t4294967300(0) o4->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:166/0 lens 504/448 e 0 to 0 dl 1787380371 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380360.444061:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ff3ff8e00 with x1874203848510464 ext(0->12) 00010000:00010000:0.0:1787380360.444071:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad690b5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac64 expref: 9 pid: 8433 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.444089:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad690b5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac64 expref: 9 pid: 8433 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380360.444113:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d6ff3ff8e00 00000100:00100000:3.0:1787380360.444474:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4f20700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1874203867473536:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380360.444495:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000872f6040/0xcf3c46fdcad69102 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380360.447238:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380360.447436:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848510592 00000100:00100000:3.0:1787380360.447444:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848510592 00010000:00010000:3.0:1787380360.447480:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad690b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac64 expref: 9 pid: 8433 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380360.447589:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 53 00000100:00100000:3.0:1787380360.447599:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:2399:x1874203848510592:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380360.447612:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787380360.447628:0:6508:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787380360.447631:0:6508:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1787380360 00002000:00010000:3.0:1787380360.447634:0:6508:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1787380361 00002000:00010000:3.0:1787380360.447636:0:6508:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1787380360 00002000:00010000:3.0:1787380360.447638:0:6508:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1787380360.447644:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad690b5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac64 expref: 9 pid: 8433 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.447658:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad690b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac64 expref: 9 pid: 8433 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.447689:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad690b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac64 expref: 9 pid: 8433 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.447706:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787380360.447711:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787380360.447716:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000872f6040/0xcf3c46fdcad69102 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.447724:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000872f6040/0xcf3c46fdcad69102 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.447767:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380360.447850:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2399:x1874203848510592:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 252us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380360.447857:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 53 00010000:00010000:0.0:1787380360.447941:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000872f6040/0xcf3c46fdcad69102 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.447953:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000872f6040/0xcf3c46fdcad69102 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.447973:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000872f6040/0xcf3c46fdcad69102 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.447982:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000872f6040/0xcf3c46fdcad69102 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.447990:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000872f6040/0xcf3c46fdcad69102 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.447997:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fda600 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380360.448002:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000872f6040/0xcf3c46fdcad69102 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.448011:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000872f6040/0xcf3c46fdcad69102 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.448033:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000872f6040/0xcf3c46fdcad69102 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.448053:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000872f6040/0xcf3c46fdcad69102 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380360.448276:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2399:x1874203848510336:12345-192.168.206.30@tcp:1:lfs.0 Request processed in 18839us (20088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380360.448286:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 31 00000100:00100000:1.0:1787380360.452146:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380360.452190:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848510848 00000100:00100000:0.0:1787380360.452199:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848510848 00000100:00100000:0.0:1787380360.452258:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:1.0:1787380360.452266:0:6525:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1787380360.452270:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:11138:x1874203848510848:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:1.0:1787380360.452277:0:6525:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000004:00010000:0.0:1787380360.452329:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad690f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac80 expref: 22 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787380360.452532:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1787380360.452582:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787380360.453217:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1787380360.453313:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69109 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.453329:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad69099 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac56 expref: 26 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.453338:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69109 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.453369:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad69099 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac56 expref: 26 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.453395:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad69099 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac56 expref: 26 pid: 10154 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380360.453410:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fff66d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1874203867473664:192.168.206.30@tcp:104: 00000100:00100000:0.0:1787380360.453531:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e51cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380360.461630:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380360.461714:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848510976 00000100:00100000:3.0:1787380360.461722:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848510976 00000100:00100000:0.0:1787380360.461743:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fff66d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1874203867473664:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380360.461759:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad69099 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac56 expref: 27 pid: 10154 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.461772:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69109 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380360.461943:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 54 00000100:00100000:3.0:1787380360.461953:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+27:2400:x1874203848510976:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380360.461967:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380360.461973:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad69099 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac56 expref: 27 pid: 10154 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.461985:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad69099 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac56 expref: 27 pid: 10154 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.462004:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad69099 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac56 expref: 27 pid: 10154 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.462018:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:3.0:1787380360.462023:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69109 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.462031:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69109 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.462049:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69109 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.462066:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380360.462375:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+26:2400:x1874203848510976:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 422us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380360.462382:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 54 00010000:00010000:0.0:1787380360.466013:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69109 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.466030:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69109 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787380360.466136:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1787380360.467773:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1787380360.467951:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fff66d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874203867473792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787380360.468017:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380360.468050:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e51300 going to sleep for 11 seconds 00000100:00100000:3.0:1787380360.468200:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867473792 00000100:00100000:3.0:1787380360.468207:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867473792 00000100:00100000:3.0:1787380360.468264:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787380360.468274:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1874203867473792:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787380360.468360:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1874203867473792:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 89us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380360.468368:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:0.0:1787380360.469274:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787380360.469369:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fff66d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874203867473792:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787380360.469843:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1787380360.469904:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fff66d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874203867473920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787380360.469958:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380360.469984:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e51b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380360.470110:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867473920 00000100:00100000:3.0:1787380360.470116:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867473920 00000100:00100000:3.0:1787380360.470158:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787380360.470176:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1874203867473920:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787380360.470572:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6524:x1874203867473920:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 397us (612us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787380360.470579:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787380360.470736:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fff66d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874203867473920:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787380360.470781:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1787380360.470848:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69109 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.470859:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69109 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.470866:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69109 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.470872:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380360.470876:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69109 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.470883:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69109 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.470897:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:2.0:1787380360.470900:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787380360.470904:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69109 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.470910:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69109 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787380360.471024:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787380360.471081:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787380360.471091:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370795281177ns, next at 371795279537ns, rc = 0 00000001:00080000:2.0:1787380360.471097:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1787380360.471118:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:2.0:1787380360.471120:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787380360.471127:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad690f4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac80 expref: 30 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380360.474069:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+29:11138:x1874203848510848:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 21013us (21142us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1787380360.474087:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 8 00000020:00080000:2.0:1787380360.474094:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787380360.487030:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380360.487116:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848511104 00000100:00100000:3.0:1787380360.487124:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848511104 00000100:00100000:3.0:1787380360.487187:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 54 00000100:00100000:3.0:1787380360.487197:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+29:11138:x1874203848511104:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1787380360.487220:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380360.487263:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69110 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac87 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.487327:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69110 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac87 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.487343:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69110 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac87 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.487361:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:3.0:1787380360.487364:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787380360.487368:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fdaa00, rc 0) 00000100:00100000:3.0:1787380360.487419:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+30:11138:x1874203848511104:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 224us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380360.487427:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 54 00000100:00100000:3.0:1787380360.492442:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380360.495670:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848511360 00000100:00100000:0.0:1787380360.495684:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848511360 00000100:00100000:0.0:1787380360.495750:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:0.0:1787380360.495760:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7be6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+30:11138:x1874203848511360:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:0.0:1787380360.495996:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7be6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+31:11138:x1874203848511360:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 237us (3561us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1787380360.496004:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:3.0:1787380360.620464:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380360.621240:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848511616 00000100:00100000:0.0:1787380360.621251:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848511616 00000100:00100000:2.0:1787380360.621860:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 55 00000100:00100000:2.0:1787380360.621874:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+31:11148:x1874203848511616:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1787380360.621894:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380360.621913:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad69117 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac8e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380360.622016:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1787380360.622110:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad69117 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac8e expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.622124:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec241b400) 00010000:00010000:2.0:1787380360.622127:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787380360.622133:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad69117 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac8e expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380360.622161:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0e000, rc 0) 00000100:00100000:2.0:1787380360.622229:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+32:11148:x1874203848511616:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 357us (1785us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1787380360.622237:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 55 00000100:00100000:1.0:1787380360.624848:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380360.626277:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848511744 00000100:00100000:0.0:1787380360.626288:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848511744 00000100:00100000:0.0:1787380360.626361:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 56 00000100:00100000:0.0:1787380360.626371:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+32:11148:x1874203848511744:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:0.0:1787380360.626448:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69125 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.626476:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69125 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.626488:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69125 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.626897:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad6912c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.626908:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad6912c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.626916:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad6912c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627012:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69133 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627021:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69133 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627028:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69133 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787380360.627072:0:10154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69133 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627085:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69125 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627091:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69125 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627097:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69125 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627103:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380360.627107:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69125 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627114:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69125 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627126:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:0.0:1787380360.627129:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380360.627133:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69125 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627146:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69125 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627158:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad6912c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627164:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad6912c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627169:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad6912c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627173:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380360.627251:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad6912c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627259:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad6912c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627267:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec25aa200) 00010000:00010000:0.0:1787380360.627269:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380360.627273:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad6912c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627278:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad6912c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627287:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69133 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627292:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69133 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627304:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69133 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627308:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380360.627310:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69133 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627325:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69133 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627333:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:0.0:1787380360.627335:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380360.627337:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69133 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380360.627343:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69133 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380360.627666:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+32:11148:x1874203848511744:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 1294us (2856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380360.627685:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 56 00000100:00100000:3.0:1787380360.632023:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380360.632295:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848512000 00000100:00100000:0.0:1787380360.632304:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848512000 00000100:00100000:0.0:1787380360.632635:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:0.0:1787380360.632645:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+32:11148:x1874203848512000:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:0.0:1787380360.632968:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+33:11148:x1874203848512000:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 324us (953us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787380360.632976:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:2.0:1787380360.694742:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380360.695692:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848512256 00000100:00100000:3.0:1787380360.695704:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848512256 00000100:00100000:3.0:1787380360.695765:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 57 00000100:00100000:3.0:1787380360.695774:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+33:11151:x1874203848512256:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1787380360.695796:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380360.695849:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad6913a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac95 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.695934:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69141 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.695964:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69141 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.695976:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69141 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.695989:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad69148 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.695996:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad69148 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.696002:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad69148 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.696108:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6914f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.696116:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6914f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.696123:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6914f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380360.696132:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787380360.696200:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69141 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.696208:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69141 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.696214:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69141 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.696226:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fda600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380360.696230:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69141 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.696238:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69141 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.696261:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:3.0:1787380360.696265:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380360.696269:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69141 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.696276:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69141 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.696288:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad69148 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.696295:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad69148 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.696300:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad69148 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.696306:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdbe00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380360.696308:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad69148 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.698039:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad69148 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.698071:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec25aa200) 00010000:00010000:3.0:1787380360.698074:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380360.698078:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad69148 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.698084:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad69148 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.698141:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad6913a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac95 expref: 36 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.698154:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6914f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac95 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.698161:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:3.0:1787380360.698164:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380360.698166:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fda000, rc 0) 00000100:00100000:3.0:1787380360.698231:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+35:11151:x1874203848512256:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 2457us (3496us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787380360.698241:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 57 00000100:00100000:2.0:1787380360.708087:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380360.708175:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848512384 00000100:00100000:3.0:1787380360.708184:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848512384 00000100:00100000:3.0:1787380360.708241:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00100000:3.0:1787380360.708260:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+35:11151:x1874203848512384:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:3.0:1787380360.708327:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad6915d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.708342:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad6915d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.708361:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad6915d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.708393:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad6915d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.708401:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad6915d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.708408:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad6915d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.708413:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdb200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380360.708417:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad6915d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.708424:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad6915d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.708436:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:3.0:1787380360.708439:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380360.708442:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad6915d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380360.708448:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad6915d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380360.708626:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+35:11151:x1874203848512384:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 376us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380360.708634:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00100000:0.0:1787380360.712554:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380360.712698:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848512640 00000100:00100000:2.0:1787380360.712706:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848512640 00000100:00100000:2.0:1787380360.712746:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:2.0:1787380360.712754:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+35:11151:x1874203848512640:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1787380360.713244:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+36:11151:x1874203848512640:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 489us (696us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787380360.713261:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:2.0:1787380361.048405:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380361.054907:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848512896 00000100:00100000:0.0:1787380361.054931:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848512896 00000100:00100000:0.0:1787380361.055004:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 59 00000100:00100000:0.0:1787380361.055014:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+36:11182:x1874203848512896:12345-192.168.206.30@tcp:101:cat.0 00010000:00010000:0.0:1787380361.055042:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380361.055075:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69164 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ac9c expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.055183:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6916b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.055198:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6916b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.055209:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6916b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380361.055220:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787380361.055334:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69164 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac9c expref: 39 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.055351:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6916b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac9c expref: 38 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.055360:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:0.0:1787380361.055363:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380361.055366:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867c00, rc 0) 00000100:00100000:0.0:1787380361.055434:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+38:11182:x1874203848512896:12345-192.168.206.30@tcp:101:cat.0 Request processed in 421us (7037us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787380361.055455:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 59 00000100:00100000:3.0:1787380361.064852:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380361.064911:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380361.064997:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848513280 00000100:00100000:0.0:1787380361.065005:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848513280 00000100:00100000:0.0:1787380361.065062:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:0.0:1787380361.065072:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+38:11182:x1874203848513280:12345-192.168.206.30@tcp:35:cat.0 00000100:00100000:0.0:1787380361.065318:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+39:11182:x1874203848513280:12345-192.168.206.30@tcp:35:cat.0 Request processed in 247us (406us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1787380361.065327:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:2.0:1787380361.065577:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848513024 00000100:00100000:2.0:1787380361.065582:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848513024 00000100:00100000:2.0:1787380361.065625:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:2.0:1787380361.065632:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+39:2399:x1874203848513024:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380361.065642:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380361.065665:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6916b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac9c expref: 39 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380361.065682:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:2.0:1787380361.065687:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380361.065731:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+38:2399:x1874203848513024:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 98us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380361.065738:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:3.0:1787380361.155076:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380361.157558:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848513536 00000100:00100000:1.0:1787380361.157573:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848513536 00000100:00100000:1.0:1787380361.157642:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 60 00000100:00100000:1.0:1787380361.157652:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+38:11188:x1874203848513536:12345-192.168.206.30@tcp:101:dd.0 00010000:00010000:1.0:1787380361.157685:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380361.157689:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787380361.157715:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad690d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac72 expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.157735:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:1.0:1787380361.157741:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380361.157763:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69179 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0aca3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.157907:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad69180 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.157935:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6914f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac95 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.157944:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad69180 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.157990:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6914f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac95 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380361.158004:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6914f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac95 expref: 38 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380361.158018:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874203867474048:192.168.206.30@tcp:104: 00000100:00100000:1.0:1787380361.158108:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc3ebc840 going to sleep for 11 seconds 00000100:00100000:1.0:1787380361.161587:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380361.161666:0:10339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848513664 00000100:00100000:2.0:1787380361.161684:0:10339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848513664 00010000:00010000:2.0:1787380361.161720:0:10339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6914f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac95 expref: 39 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380361.161769:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 55 00000100:00100000:2.0:1787380361.161779:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+39:2399:x1874203848513664:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380361.161792:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380361.161798:0:10339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6914f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac95 expref: 39 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380361.161843:0:10339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6914f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac95 expref: 39 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380361.161864:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:2.0:1787380361.161869:0:10339:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad69180 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380361.161878:0:10339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad69180 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380361.161884:0:10339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad69180 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380361.161901:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380361.161958:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+39:2399:x1874203848513664:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 181us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380361.161979:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 55 00010000:00010000:3.0:1787380361.163296:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6914f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac95 expref: 38 pid: 6522 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380361.163387:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874203867474048:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380361.163411:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad69180 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.163420:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad69180 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.163427:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad69180 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380361.163444:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787380361.163750:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69179 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aca3 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.163767:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad69180 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aca3 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.163774:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:3.0:1787380361.163777:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787380361.163780:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc165b000, rc 0) 00000100:00100000:3.0:1787380361.163938:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3daf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+38:11188:x1874203848513536:12345-192.168.206.30@tcp:101:dd.0 Request processed in 6287us (8870us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787380361.163946:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 60 00000100:00100000:1.0:1787380361.166989:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380361.167079:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848513792 00000100:00100000:0.0:1787380361.167089:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848513792 00000100:00100000:0.0:1787380361.167224:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 61 00000100:00100000:0.0:1787380361.167234:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+38:11188:x1874203848513792:12345-192.168.206.30@tcp:101:dd.0 00010000:00010000:0.0:1787380361.167254:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380361.167271:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6918e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0acaa expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.167299:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69195 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.167371:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69195 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.167387:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69195 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.167510:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6918e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acaa expref: 40 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.167540:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69195 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acaa expref: 39 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.167548:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:0.0:1787380361.167551:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787380361.167555:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866200, rc 0) 00000100:00100000:0.0:1787380361.167652:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+39:11188:x1874203848513792:12345-192.168.206.30@tcp:101:dd.0 Request processed in 420us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380361.167660:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 61 00000100:00100000:1.0:1787380361.170533:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380361.170581:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848514048 00000100:00100000:3.0:1787380361.170601:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848514048 00000100:00100000:3.0:1787380361.170661:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 62 00000100:00100000:3.0:1787380361.170765:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+39:11188:x1874203848514048:12345-192.168.206.30@tcp:36:dd.0 00010000:00010000:2.0:1787380361.171295:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6919c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380361.171310:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6919c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380361.171317:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6919c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787380361.171345:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1787380361.171357:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006de4837c reply state 0000000087fc1a57 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6919c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380361.171365:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6919c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380361.171370:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:2.0:1787380361.171372:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787380361.171374:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787380361.171454:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+42:11188:x1874203848514048:12345-192.168.206.30@tcp:36:dd.0 Request processed in 785us (929us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1787380361.171462:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 62 00000020:00080000:2.0:1787380361.171467:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787380361.292130:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380361.483619:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380361.483717:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848514176 00000100:00100000:3.0:1787380361.483726:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848514176 00000100:00100000:3.0:1787380361.483782:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 63 00000100:00100000:3.0:1787380361.483792:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+42:11201:x1874203848514176:12345-192.168.206.30@tcp:101:stat.0 00010000:00010000:3.0:1787380361.483842:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380361.483862:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad691a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0acb1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.483934:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad691aa lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.483948:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad691aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.483958:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad691aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.483969:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad691b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.483975:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad691b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.483981:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad691b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.484050:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad691b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.484073:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad69180 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aca3 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.484081:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad691b8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.484114:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad69180 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aca3 expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.484127:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad69180 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aca3 expref: 43 pid: 6521 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380361.484139:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3dad880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874203867474176:192.168.206.30@tcp:104: 00000100:00100000:3.0:1787380361.486470:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec2779480 going to sleep for 11 seconds 00000100:00100000:3.0:1787380361.492556:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3dad880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874203867474176:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380361.492583:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad691b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380361.492758:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380361.492836:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848514432 00000100:00100000:0.0:1787380361.492843:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848514432 00000100:00100000:0.0:1787380361.492895:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:0.0:1787380361.492904:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+44:6167:x1874203848514432:12345-192.168.206.30@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787380361.493403:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+45:6167:x1874203848514432:12345-192.168.206.30@tcp:35:ldlm_bl.0 Request processed in 285us (431us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1787380361.493412:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:1.0:1787380361.496056:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380361.496146:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848514560 00000100:00100000:2.0:1787380361.496154:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848514560 00010000:00010000:2.0:1787380361.496198:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad69180 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aca3 expref: 45 pid: 6521 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380361.496235:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 56 00000100:00100000:2.0:1787380361.496257:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+45:2399:x1874203848514560:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380361.496271:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380361.496277:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad69180 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aca3 expref: 45 pid: 6521 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380361.496289:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad69180 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aca3 expref: 45 pid: 6521 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380361.496309:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad69180 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aca3 expref: 45 pid: 6521 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380361.496324:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:2.0:1787380361.496329:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad691b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380361.496338:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad691b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380361.496345:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad691b8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380361.496374:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380361.496424:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+44:2399:x1874203848514560:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 168us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380361.496432:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 56 00010000:00010000:3.0:1787380361.496628:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad691b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.496636:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad691b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380361.496683:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787380361.496688:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787380361.496722:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad691b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.496745:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad691b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.496755:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad691aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.496760:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad691aa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.496765:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad691aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.496771:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdbe00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380361.496775:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad691aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.496781:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad691aa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.496789:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:3.0:1787380361.496792:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380361.496796:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad691aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.496801:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad691aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.496852:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad691b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.496859:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad691b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.496870:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad691b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.496874:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdb200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380361.496877:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad691b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.496883:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad691b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.496892:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec25aa200) 00010000:00010000:3.0:1787380361.496894:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380361.496897:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad691b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.496902:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad691b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.496943:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad691a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acb1 expref: 44 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.496955:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad691b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acb1 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.496961:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:3.0:1787380361.496963:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380361.496965:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fda600, rc 0) 00000100:00100000:3.0:1787380361.496992:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+43:11201:x1874203848514176:12345-192.168.206.30@tcp:101:stat.0 Request processed in 13202us (13388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380361.497007:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 63 00000040:00080000:3.0:1787380361.548438:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1787380361.549938:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787380361.625049:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380361.625216:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848514816 00000100:00100000:3.0:1787380361.625225:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848514816 00000100:00100000:3.0:1787380361.625280:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 64 00000100:00100000:3.0:1787380361.625289:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+43:11208:x1874203848514816:12345-192.168.206.30@tcp:36:truncate.0 00010000:00010000:3.0:1787380361.625335:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380361.625358:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad691b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acb1 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.625376:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:3.0:1787380361.625380:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380361.625520:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad691bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.625533:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad691bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.625543:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad691bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787380361.625579:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1787380361.625598:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000552d5a8f reply state 00000000b849cc7b transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad691bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.625610:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad691bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380361.625616:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:3.0:1787380361.625629:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787380361.625632:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380361.625736:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+45:11208:x1874203848514816:12345-192.168.206.30@tcp:36:truncate.0 Request processed in 447us (695us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787380361.625742:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 64 00000020:00080000:3.0:1787380361.625746:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000004:00080000:3.0:1787380361.872513:0:9843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 372196700795ns, next at 373196698254ns, rc = 0 00000100:00100000:3.0:1787380361.872539:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380361.872558:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867474304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380361.872629:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380361.872955:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867474304 00000100:00100000:2.0:1787380361.872963:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867474304 00000100:00100000:2.0:1787380361.873039:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787380361.873049:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3daed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874203867474304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787380361.873090:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787380361.873133:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3daed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874203867474304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380361.873140:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787380361.873375:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867474560:0@lo:400:kworker.0 00000100:00100000:1.0:1787380361.873408:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380361.873431:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380361.873437:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867474688:0@lo:400:kworker.0 00000100:00100000:1.0:1787380361.873459:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380361.873630:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867475072:0@lo:400:kworker.0 00000100:00100000:1.0:1787380361.873655:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380361.873679:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867475584:0@lo:400:kworker.0 00000100:00100000:1.0:1787380361.873717:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380361.873740:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787380361.873746:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec335b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867475200:0@lo:400:kworker.0 00000100:00100000:1.0:1787380361.873766:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380361.873778:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867475712:0@lo:400:kworker.0 00000100:00100000:1.0:1787380361.873796:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380361.874524:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867474816:0@lo:400:kworker.0 00000100:00100000:0.0:1787380361.874573:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380361.874592:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1874203867475328:0@lo:400:kworker.0 00000100:00100000:0.0:1787380361.874623:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380361.874639:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867475840:0@lo:400:kworker.0 00000100:00100000:0.0:1787380361.874655:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380361.874667:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1787380361.874683:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867474432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380361.874716:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380361.874732:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867474944:0@lo:400:kworker.0 00000100:00100000:0.0:1787380361.874751:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380361.874760:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867475456:0@lo:400:kworker.0 00000100:00100000:0.0:1787380361.874778:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380361.874793:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867475968:0@lo:400:kworker.0 00000100:00100000:0.0:1787380361.874830:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380361.874857:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867475072 00000100:00100000:0.0:1787380361.874863:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867475072 00000100:00100000:0.0:1787380361.874890:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867474816 00000100:00100000:0.0:1787380361.874893:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867474816 00000100:00100000:0.0:1787380361.874905:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867474432 00000100:00100000:0.0:1787380361.874907:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867474432 00000100:00100000:0.0:1787380361.874928:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787380361.874935:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867475072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380361.874983:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867475072:12345-0@lo:400:kworker.0 Request processed in 48us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380361.874990:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787380361.875005:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787380361.875011:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1874203867474816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380361.875055:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3641:x1874203867474816:12345-0@lo:400:kworker.0 Request processed in 44us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380361.875061:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787380361.875072:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787380361.875078:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867474432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787380361.875108:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1787380361.875138:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867474432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380361.875304:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787380361.875325:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867475584 00000100:00100000:0.0:1787380361.875329:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867475584 00000100:00100000:0.0:1787380361.875358:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867475456 00000100:00100000:0.0:1787380361.875361:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867475456 00000100:00100000:0.0:1787380361.875377:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867475968 00000100:00100000:0.0:1787380361.875380:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867475968 00000100:00100000:0.0:1787380361.875393:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787380361.875399:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867475584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380361.875433:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867475584:12345-0@lo:400:kworker.0 Request processed in 34us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380361.875440:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787380361.875450:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787380361.875456:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867475456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380361.875484:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867475456:12345-0@lo:400:kworker.0 Request processed in 28us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380361.875490:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787380361.875501:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787380361.875507:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867475968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380361.875534:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867475968:12345-0@lo:400:kworker.0 Request processed in 28us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380361.875540:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1787380361.875554:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380361.875558:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380361.875574:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867474688 00000100:00100000:0.0:1787380361.875578:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867474688 00000100:00100000:0.0:1787380361.875595:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787380361.875601:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867474688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380361.875739:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867475200 00000100:00100000:2.0:1787380361.875744:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867475200 00000100:00100000:2.0:1787380361.875769:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867475712 00000100:00100000:2.0:1787380361.875772:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867475712 00000100:00100000:2.0:1787380361.875787:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867475328 00000100:00100000:2.0:1787380361.875790:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867475328 00000100:00100000:2.0:1787380361.875801:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867475840 00000100:00100000:2.0:1787380361.875804:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867475840 00000100:00100000:2.0:1787380361.875873:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867474432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380361.875887:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867475456:0@lo:400:kworker.0 00000100:00100000:2.0:1787380361.875897:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867475968:0@lo:400:kworker.0 00000100:00100000:2.0:1787380361.875905:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867474816:0@lo:400:kworker.0 00000100:00100000:2.0:1787380361.875954:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867474944 00000100:00100000:2.0:1787380361.875957:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867474944 00000100:00100000:2.0:1787380361.875972:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787380361.875979:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867475200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380361.876013:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867475200:12345-0@lo:400:kworker.0 Request processed in 35us (2245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380361.876020:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787380361.876032:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787380361.876038:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867475712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380361.876065:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867475712:12345-0@lo:400:kworker.0 Request processed in 27us (2267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380361.876078:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787380361.876090:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787380361.876096:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874203867475328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380361.876129:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874203867475328:12345-0@lo:400:kworker.0 Request processed in 34us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380361.876135:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00010000:00080000:2.0:1787380361.876172:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3d07b80 x1874203867475328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380361.876183:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1874203867475328:0@lo:400:kworker.0 00000100:00100000:2.0:1787380361.876202:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787380361.876208:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874203867475840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380361.876240:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874203867475840:12345-0@lo:400:kworker.0 Request processed in 32us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380361.876245:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00010000:00080000:2.0:1787380361.876266:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3d04e00 x1874203867475840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380361.876276:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867475840:0@lo:400:kworker.0 00000100:00100000:2.0:1787380361.876291:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787380361.876298:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867474944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380361.876329:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867474944:12345-0@lo:400:kworker.0 Request processed in 32us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380361.876335:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787380361.876357:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867474944:0@lo:400:kworker.0 00000100:00080000:2.0:1787380361.876465:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787380361.876469:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380361.878532:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867474688:12345-0@lo:400:kworker.0 Request processed in 2921us (5061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380361.878545:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787380361.878670:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867474560 00000100:00100000:3.0:1787380361.878677:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867474560 00000100:00100000:3.0:1787380361.878729:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1787380361.878737:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867474560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380361.878771:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867474560:12345-0@lo:400:kworker.0 Request processed in 35us (5362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380361.878777:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1787380361.878869:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867474304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787380361.879131:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867476096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787380361.879178:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380361.879209:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec335b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867475200:0@lo:400:kworker.0 00000100:00100000:1.0:1787380361.879223:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867475712:0@lo:400:kworker.0 00000100:00100000:1.0:1787380361.879233:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867475072:0@lo:400:kworker.0 00000100:00100000:1.0:1787380361.879243:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867475584:0@lo:400:kworker.0 00000100:00100000:1.0:1787380361.879252:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867474688:0@lo:400:kworker.0 00000100:00100000:1.0:1787380361.879261:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867474560:0@lo:400:kworker.0 00000100:00100000:2.0:1787380361.880851:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867476096 00000100:00100000:2.0:1787380361.880862:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867476096 00000100:00100000:2.0:1787380361.880926:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787380361.880936:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867476096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787380361.880959:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787380361.881017:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867476096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (1838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380361.881034:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787380361.882345:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380361.882628:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848514944 00000100:00100000:0.0:1787380361.882635:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848514944 00000100:00100000:0.0:1787380361.882683:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 65 00000100:00100000:0.0:1787380361.882697:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+45:11222:x1874203848514944:12345-192.168.206.30@tcp:101:stat.0 00010000:00010000:0.0:1787380361.882719:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380361.882738:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad691c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0acb8 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.882799:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad691cd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.882846:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad691cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.882860:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad691cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.882872:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.882878:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.882884:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.882977:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad691db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.882987:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad691db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.882995:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad691db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380361.883525:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787380361.883530:0:10154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787380361.883556:0:10154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad691db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.883568:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad691db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.883577:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad691cd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.883584:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad691cd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.883590:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad691cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.883595:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380361.883600:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad691cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.883618:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad691cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.883638:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:0.0:1787380361.883641:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380361.883646:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad691cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.883652:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad691cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.883665:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.883672:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691d4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.883678:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.883683:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380361.883687:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.883692:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691d4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.883700:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec25aa200) 00010000:00010000:0.0:1787380361.883702:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380361.883705:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.883711:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.883751:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad691c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acb8 expref: 47 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.883764:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad691db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acb8 expref: 46 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380361.883771:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:0.0:1787380361.883773:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380361.883776:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867000, rc 0) 00000100:00100000:0.0:1787380361.883870:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+46:11222:x1874203848514944:12345-192.168.206.30@tcp:101:stat.0 Request processed in 1173us (1528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380361.883878:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 65 00000100:00100000:1.0:1787380361.883997:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867476096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787380362.017440:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380362.017542:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848515200 00000100:00100000:3.0:1787380362.017551:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848515200 00000100:00100000:3.0:1787380362.017624:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00100000:3.0:1787380362.017634:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+46:11232:x1874203848515200:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1787380362.017652:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380362.017669:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad691e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0acbf expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380362.017774:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1787380362.017929:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad691e2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acbf expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.017944:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec241b400) 00010000:00010000:3.0:1787380362.017947:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380362.017952:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad691e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acbf expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.017966:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fda600, rc 0) 00000100:00100000:3.0:1787380362.018016:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+47:11232:x1874203848515200:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 383us (584us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1787380362.018023:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00080000:2.0:1787380362.018753:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380362.021420:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380362.021507:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848515456 00000100:00100000:3.0:1787380362.021516:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848515456 00000100:00100000:3.0:1787380362.021572:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:3.0:1787380362.021582:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+47:11232:x1874203848515456:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:3.0:1787380362.021803:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+48:11232:x1874203848515456:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 221us (389us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1787380362.021832:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:1.0:1787380362.086560:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380362.086722:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848515712 00000100:00100000:0.0:1787380362.086731:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848515712 00000100:00100000:0.0:1787380362.086790:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 67 00000100:00100000:0.0:1787380362.086800:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+48:11238:x1874203848515712:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1787380362.086850:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380362.086869:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad691f0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0acc6 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.086978:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691f7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.086992:0:10154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad691db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acb8 expref: 49 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.087001:0:10154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691f7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.087045:0:10154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad691db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acb8 expref: 49 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.087058:0:10154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad691db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acb8 expref: 49 pid: 10154 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380362.087071:0:10154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fff66f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10154:1874203867476224:192.168.206.30@tcp:104: 00000100:00100000:0.0:1787380362.087165:0:10154:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e51cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380362.091989:0:10154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fff66f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10154:1874203867476224:192.168.206.30@tcp:104: 00010000:00010000:0.0:1787380362.092018:0:10154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691f7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380362.092558:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380362.092651:0:10339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848515840 00000100:00100000:2.0:1787380362.092658:0:10339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848515840 00010000:00010000:2.0:1787380362.092701:0:10339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad691db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acb8 expref: 50 pid: 10154 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380362.092736:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 57 00000100:00100000:2.0:1787380362.092744:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd68cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+50:2399:x1874203848515840:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380362.092758:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380362.092764:0:10339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad691db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acb8 expref: 50 pid: 10154 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.092777:0:10339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad691db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acb8 expref: 50 pid: 10154 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.092798:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad691db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acb8 expref: 50 pid: 10154 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.092859:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:2.0:1787380362.093007:0:10339:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691f7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.093020:0:10339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.093028:0:10339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691f7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.093100:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380362.093166:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd68cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+49:2399:x1874203848515840:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 420us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380362.093174:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 57 00010000:00010000:1.0:1787380362.096217:0:10154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.096236:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380362.096277:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1787380362.096950:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad691f0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acc6 expref: 50 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.096971:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691f7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acc6 expref: 49 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.096980:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:1.0:1787380362.096983:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787380362.096986:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867a00, rc 0) 00000100:00100000:1.0:1787380362.097054:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+49:11238:x1874203848515712:12345-192.168.206.30@tcp:101:bash.0 Request processed in 10255us (10502us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787380362.097063:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 67 00000100:00100000:0.0:1787380362.100908:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380362.101472:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848516096 00000100:00100000:3.0:1787380362.101482:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848516096 00000100:00100000:3.0:1787380362.101574:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 68 00000100:00100000:3.0:1787380362.101584:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+49:11238:x1874203848516096:12345-192.168.206.30@tcp:36:bash.0 00010000:00010000:3.0:1787380362.101836:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69205 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.101852:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69205 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.101877:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69205 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787380362.101931:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1787380362.101953:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f81e87a6 reply state 0000000049353d2f transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69205 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.101966:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69205 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.101973:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:3.0:1787380362.101976:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787380362.101979:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380362.102062:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+52:11238:x1874203848516096:12345-192.168.206.30@tcp:36:bash.0 Request processed in 479us (1257us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1787380362.102070:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 68 00000020:00080000:3.0:1787380362.102074:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787380362.112362:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380362.112508:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848516224 00000100:00100000:2.0:1787380362.112517:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848516224 00000100:00100000:2.0:1787380362.112573:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 69 00000100:00100000:2.0:1787380362.112583:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+52:11238:x1874203848516224:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:2.0:1787380362.112604:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380362.112633:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad6920c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0accd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.112752:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69213 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.112766:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691f7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acc6 expref: 53 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.112786:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69213 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.112846:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691f7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acc6 expref: 53 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.112859:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691f7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acc6 expref: 53 pid: 10154 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380362.112871:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d07b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867476352:192.168.206.30@tcp:104: 00000100:00100000:2.0:1787380362.112957:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787380362.117745:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380362.117859:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848516352 00000100:00100000:3.0:1787380362.117868:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848516352 00010000:00010000:3.0:1787380362.117905:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691f7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acc6 expref: 54 pid: 10154 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380362.117945:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00100000:3.0:1787380362.117954:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+54:2399:x1874203848516352:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380362.117968:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380362.117974:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691f7 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acc6 expref: 54 pid: 10154 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.118006:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691f7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acc6 expref: 54 pid: 10154 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.118028:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:3.0:1787380362.118033:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69213 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.118042:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69213 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.118050:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69213 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.118067:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380362.118119:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+54:2399:x1874203848516352:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 166us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380362.118127:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 58 00010000:00010000:2.0:1787380362.118351:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad691f7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acc6 expref: 53 pid: 10154 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380362.118367:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d07b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867476352:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380362.118384:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69213 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.118392:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69213 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.118397:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69213 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380362.118438:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787380362.118441:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787380362.118465:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69213 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.118494:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad6920c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0accd expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.118504:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69213 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0accd expref: 52 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.118508:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:2.0:1787380362.118510:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380362.118512:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0f200, rc 0) 00000100:00100000:2.0:1787380362.118540:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+52:11238:x1874203848516224:12345-192.168.206.30@tcp:101:bash.0 Request processed in 5960us (6187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380362.118544:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 69 00000100:00100000:1.0:1787380362.125293:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380362.125952:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848516608 00000100:00100000:0.0:1787380362.125962:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848516608 00000100:00100000:0.0:1787380362.126020:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:0.0:1787380362.126031:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7be2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+52:11238:x1874203848516608:12345-192.168.206.30@tcp:35:bash.0 00000100:00100000:0.0:1787380362.126517:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7be2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+53:11238:x1874203848516608:12345-192.168.206.30@tcp:35:bash.0 Request processed in 486us (1230us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787380362.126525:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:3.0:1787380362.244783:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380362.245011:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848516864 00000100:00100000:0.0:1787380362.245021:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848516864 00000100:00100000:0.0:1787380362.245103:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 70 00000100:00100000:0.0:1787380362.245114:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+53:11248:x1874203848516864:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1787380362.245173:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380362.245200:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad6921a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0acd4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380362.245315:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1787380362.245419:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad6921a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acd4 expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.245435:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec241b400) 00010000:00010000:0.0:1787380362.245438:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787380362.245443:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad6921a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acd4 expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.245470:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867400, rc 0) 00000100:00100000:0.0:1787380362.245530:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+54:11248:x1874203848516864:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 418us (756us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1787380362.245537:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 70 00000100:00100000:1.0:1787380362.250550:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380362.250667:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848516992 00000100:00100000:0.0:1787380362.250694:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848516992 00000100:00100000:0.0:1787380362.250751:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 71 00000100:00100000:0.0:1787380362.250760:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+54:11248:x1874203848516992:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:0.0:1787380362.250861:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69228 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.250877:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69228 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.250887:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69228 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.250912:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6922f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.250930:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6922f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.250937:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6922f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251005:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69236 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251015:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69236 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251021:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69236 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787380362.251064:0:10154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69236 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251076:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69228 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251082:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69228 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251087:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69228 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251092:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380362.251096:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69228 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251109:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69228 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251121:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:0.0:1787380362.251124:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380362.251128:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69228 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251134:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69228 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251146:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6922f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251151:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6922f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251156:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6922f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251161:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380362.251163:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6922f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251169:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6922f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251175:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec25aa200) 00010000:00010000:0.0:1787380362.251177:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380362.251180:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6922f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251194:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6922f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251205:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69236 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251209:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69236 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251215:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69236 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251219:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380362.251222:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69236 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251227:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69236 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251234:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:0.0:1787380362.251236:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380362.251239:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69236 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.251244:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69236 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380362.251643:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+54:11248:x1874203848516992:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 881us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380362.251652:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 71 00000100:00100000:1.0:1787380362.255657:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380362.256014:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848517248 00000100:00100000:2.0:1787380362.256023:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848517248 00000100:00100000:2.0:1787380362.256109:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:2.0:1787380362.256120:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+54:11248:x1874203848517248:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1787380362.256401:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+55:11248:x1874203848517248:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 282us (752us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787380362.256409:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:3.0:1787380362.294185:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380362.295037:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848517504 00000100:00100000:0.0:1787380362.295049:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848517504 00000100:00100000:0.0:1787380362.295155:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 72 00000100:00100000:0.0:1787380362.295166:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+55:11251:x1874203848517504:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1787380362.295189:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380362.295209:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6923d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0acdb expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295275:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69244 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295289:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69244 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295299:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69244 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295322:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6924b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295329:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6924b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295335:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6924b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295427:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69252 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295436:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69252 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295473:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69252 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380362.295484:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787380362.295551:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69244 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295559:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69244 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295565:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69244 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295571:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380362.295575:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69244 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295582:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69244 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295593:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:0.0:1787380362.295596:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380362.295600:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69244 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295605:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69244 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295617:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6924b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295623:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6924b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295634:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6924b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295639:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380362.295642:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6924b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295647:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6924b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295653:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec25aa200) 00010000:00010000:0.0:1787380362.295655:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380362.295658:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6924b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295662:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6924b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295889:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6923d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acdb expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295902:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69252 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acdb expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.295909:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:0.0:1787380362.295911:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380362.295923:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867400, rc 0) 00000100:00100000:0.0:1787380362.295988:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+57:11251:x1874203848517504:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 823us (1811us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787380362.296004:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 72 00000100:00100000:1.0:1787380362.311093:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380362.313172:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380362.313607:0:10339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848517760 00000100:00100000:3.0:1787380362.313618:0:10339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848517760 00000100:00100000:3.0:1787380362.313686:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:3.0:1787380362.313696:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+57:2398:x1874203848517760:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380362.313712:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380362.313734:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69252 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acdb expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.313771:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:3.0:1787380362.313776:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380362.313860:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+56:2398:x1874203848517760:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 165us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380362.313869:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:2.0:1787380362.314364:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848517632 00000100:00100000:2.0:1787380362.314370:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848517632 00000100:00100000:2.0:1787380362.314449:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 73 00000100:00100000:2.0:1787380362.314458:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+56:11251:x1874203848517632:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:2.0:1787380362.314510:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69260 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.314540:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69260 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.314551:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69260 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.314586:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69260 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.314593:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69260 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.314599:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69260 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.314604:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0f600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380362.314608:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69260 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.314615:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69260 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.314624:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:2.0:1787380362.314627:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787380362.314629:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69260 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.314634:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69260 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380362.314694:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+56:11251:x1874203848517632:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 238us (3608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380362.314708:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 73 00010000:00010000:1.0:1787380362.315937:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380362.317336:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380362.317401:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848518016 00000100:00100000:3.0:1787380362.317410:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848518016 00000100:00100000:3.0:1787380362.317461:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:3.0:1787380362.317471:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+56:11251:x1874203848518016:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:3.0:1787380362.317710:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+57:11251:x1874203848518016:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 240us (378us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1787380362.317718:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:3.0:1787380362.380080:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867476480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380362.380148:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380362.380266:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867476480 00000100:00100000:2.0:1787380362.380273:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867476480 00000100:00100000:2.0:1787380362.380323:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787380362.380331:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867476480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380362.380357:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380362.380396:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867476480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380362.380403:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787380362.380487:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d07b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867476480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380362.380685:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380362.380696:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867476608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380362.380724:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380362.380801:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867476608 00000100:00100000:0.0:1787380362.380806:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867476608 00000100:00100000:0.0:1787380362.380862:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787380362.380869:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867476608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787380362.380879:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380362.380929:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867476608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380362.380935:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787380362.381007:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867476608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787380362.397903:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380362.397951:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380362.398025:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380362.398057:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380362.398084:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380362.398138:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848518656 00000100:00100000:1.0:1787380362.398147:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848518656 00000100:00100000:1.0:1787380362.398192:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848518272 00000100:00100000:1.0:1787380362.398194:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848518272 00000100:00100000:1.0:1787380362.398208:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848518528 00000100:00100000:1.0:1787380362.398210:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848518528 00000100:00100000:1.0:1787380362.398226:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 277 00000100:00100000:1.0:1787380362.398234:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848518656:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380362.398303:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848518656:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 69us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380362.398310:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 277 00000100:00100000:1.0:1787380362.398327:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 278 00000100:00100000:1.0:1787380362.398334:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2397:x1874203848518272:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380362.398357:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2397:x1874203848518272:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 24us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380362.398363:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 278 00000100:00100000:1.0:1787380362.398374:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 279 00000100:00100000:1.0:1787380362.398380:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848518528:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380362.398402:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848518528:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 23us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380362.398408:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 279 00000100:00100000:3.0:1787380362.400981:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848518144 00000100:00100000:3.0:1787380362.400994:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848518144 00000100:00100000:3.0:1787380362.401060:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 378 00000100:00100000:3.0:1787380362.401069:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2397:x1874203848518144:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380362.401151:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2397:x1874203848518144:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 83us (3256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380362.401159:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 378 00000100:00080000:2.0:1787380362.401257:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380362.401262:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787380362.402783:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848518400 00000100:00100000:0.0:1787380362.402793:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848518400 00000100:00100000:0.0:1787380362.402935:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 103 00000100:00100000:0.0:1787380362.402946:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2397:x1874203848518400:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380362.403015:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2397:x1874203848518400:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 72us (5063us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380362.403021:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 103 00000100:00080000:2.0:1787380362.404910:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787380362.483132:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380362.483325:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848518912 00000100:00100000:0.0:1787380362.483334:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848518912 00000100:00100000:0.0:1787380362.483385:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 74 00000100:00100000:0.0:1787380362.483394:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+57:11269:x1874203848518912:12345-192.168.206.30@tcp:101:cat.0 00010000:00010000:0.0:1787380362.483423:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380362.483441:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69267 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ace2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.483527:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6926e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.483551:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6926e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.483562:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6926e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380362.483574:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787380362.483688:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69267 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ace2 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.483705:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6926e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ace2 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.483713:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:0.0:1787380362.483716:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787380362.483719:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866600, rc 0) 00000100:00100000:0.0:1787380362.485777:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:11269:x1874203848518912:12345-192.168.206.30@tcp:101:cat.0 Request processed in 375us (645us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1787380362.485790:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 74 00000100:00100000:3.0:1787380362.520220:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380362.520427:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848519040 00000100:00100000:2.0:1787380362.520436:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848519040 00000100:00100000:2.0:1787380362.520502:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 75 00000100:00100000:2.0:1787380362.520511:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:11270:x1874203848519040:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1787380362.520533:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380362.520551:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e800/0xcf3c46fdcad6927c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ace9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.520614:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69283 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.520628:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69283 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.520639:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69283 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380362.520694:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1787380362.520698:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787380362.520714:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69283 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.520737:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e800/0xcf3c46fdcad6927c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ace9 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.520753:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69283 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ace9 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.520761:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:2.0:1787380362.520764:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787380362.520767:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0f800, rc 0) 00000100:00100000:2.0:1787380362.520872:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:11270:x1874203848519040:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 362us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380362.520879:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 75 00000100:00100000:2.0:1787380362.534447:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380362.534547:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848519424 00000100:00100000:0.0:1787380362.534555:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848519424 00000100:00100000:0.0:1787380362.534605:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:0.0:1787380362.534614:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:11270:x1874203848519424:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:0.0:1787380362.535321:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+61:11270:x1874203848519424:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 706us (881us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1787380362.535330:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:1.0:1787380362.538580:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380362.540014:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848519552 00000100:00100000:3.0:1787380362.540025:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848519552 00000100:00100000:3.0:1787380362.540093:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:3.0:1787380362.540103:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+61:11270:x1874203848519552:12345-192.168.206.30@tcp:103:lfs.0 00010000:00010000:3.0:1787380362.540117:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787380362.540140:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69213 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0accd expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.540162:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6926e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ace2 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.540175:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69110 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac87 expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.540184:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:3.0:1787380362.540189:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380362.540244:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+58:11270:x1874203848519552:12345-192.168.206.30@tcp:103:lfs.0 Request processed in 142us (1672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380362.540252:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:3.0:1787380362.549140:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380362.549739:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848519680 00000100:00100000:1.0:1787380362.549748:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848519680 00000100:00100000:1.0:1787380362.549849:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 76 00000100:00100000:1.0:1787380362.549869:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec361c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+58:11270:x1874203848519680:12345-192.168.206.30@tcp:58:lfs.0 00010000:00010000:1.0:1787380362.549978:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad6928a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.549992:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad6928a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.550004:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad6928a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787380362.550175:0:10154:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380362.550299:0:10154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787380362.550501:0:10154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787380362.550579:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec361c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+58:11270:x1874203848519680:12345-192.168.206.30@tcp:58:lfs.0 Request processed in 711us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380362.550588:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 76 00000040:00080000:2.0:1787380362.572246:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787380362.572256:0:13800:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787380362.572298:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787380362.572317:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787380362.572443:0:13800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d05180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1874203867476736:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787380362.572542:0:13800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76180 going to sleep for 11 seconds 00000100:00100000:3.0:1787380362.582154:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380362.583639:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848519808 00000100:00100000:0.0:1787380362.583672:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848519808 00000100:00100000:0.0:1787380362.583726:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 77 00000100:00100000:0.0:1787380362.583737:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:11274:x1874203848519808:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787380362.583766:0:6521:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787380362.583925:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:11274:x1874203848519808:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 180us (1771us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380362.583933:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 77 00000100:00100000:1.0:1787380362.586758:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380362.591196:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848519936 00000100:00100000:0.0:1787380362.591211:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848519936 00000100:00100000:0.0:1787380362.591280:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 78 00000100:00100000:0.0:1787380362.591290:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:11272:x1874203848519936:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1787380362.591308:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380362.591327:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69291 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0acf0 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591384:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69298 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591398:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69298 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591408:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69298 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591418:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6929f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591425:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6929f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591449:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6929f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380362.591467:0:13800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d05180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1874203867476736:192.168.206.30@tcp:107:hsm_cdtr.0 00010000:00010000:0.0:1787380362.591511:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad692a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591519:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad692a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591525:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad692a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380362.591560:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787380362.591564:0:10154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787380362.591580:0:10154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad692a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591589:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad692a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591597:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69298 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591602:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69298 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591607:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69298 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591612:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380362.591615:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69298 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591641:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69298 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591653:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:0.0:1787380362.591656:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380362.591661:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69298 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591667:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69298 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591680:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6929f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591686:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6929f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591692:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6929f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591697:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380362.591700:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6929f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591706:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6929f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591714:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec25aa200) 00010000:00010000:0.0:1787380362.591716:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380362.591719:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6929f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591735:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6929f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591760:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69291 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acf0 expref: 60 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591774:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad692a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acf0 expref: 59 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.591781:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:0.0:1787380362.591783:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787380362.591786:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866800, rc 0) 00000100:00100000:0.0:1787380362.593151:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:11272:x1874203848519936:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 1858us (6395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380362.593161:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 78 00000100:00100000:3.0:1787380362.608055:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380362.610370:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848520064 00000100:00100000:0.0:1787380362.610382:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848520064 00000100:00100000:0.0:1787380362.610446:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 79 00000100:00100000:0.0:1787380362.610577:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:11274:x1874203848520064:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787380362.610754:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692ad lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.611064:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.611077:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.611132:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad692b4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.611140:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad692b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.611145:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad692b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.611288:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.611299:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.611307:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380362.611350:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787380362.611354:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787380362.611368:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.611379:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.611385:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692ad lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.611392:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692ad lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.611409:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380362.611413:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692ad lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.611421:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692ad lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.611432:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6ec25a8300) 00010000:00010000:0.0:1787380362.611435:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380362.611440:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.611447:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.612797:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad692b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.612906:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad692b4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.612923:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad692b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.612930:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380362.612933:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad692b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.612941:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad692b4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.612968:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9d6ec26f4100) 00010000:00010000:0.0:1787380362.612970:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380362.612974:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad692b4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.612979:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad692b4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.612995:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.613001:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.613007:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.613012:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380362.613015:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.613021:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.613029:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:0.0:1787380362.613031:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380362.613034:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692bb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.613040:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380362.613136:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:11274:x1874203848520064:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 Request processed in 2561us (5086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380362.613146:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 79 00000100:00100000:3.0:1787380362.623100:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380362.623878:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848520320 00000100:00100000:1.0:1787380362.623888:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848520320 00000100:00100000:1.0:1787380362.623959:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 80 00000100:00100000:1.0:1787380362.623970:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:11274:x1874203848520320:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787380362.623989:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380362.624008:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad692c2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0acf7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.624105:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad692c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.624118:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad692c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.624141:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad692c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380362.624152:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787380362.624344:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad692c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.624353:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad692c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.624359:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad692c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.624365:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165ae00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380362.624369:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad692c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.624375:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad692c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.624386:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:1.0:1787380362.624390:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787380362.624394:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad692c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.624400:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad692c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.624440:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad692c2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acf7 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.624512:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6ec25a8300) 00010000:00010000:1.0:1787380362.624514:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787380362.624518:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad692c2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acf7 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.624528:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc165b000, rc 0) 00000100:00100000:1.0:1787380362.624674:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:11274:x1874203848520320:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 706us (1581us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1787380362.624690:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 80 00000100:00100000:1.0:1787380362.632583:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380362.632667:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848520448 00000100:00100000:3.0:1787380362.632677:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848520448 00000100:00100000:3.0:1787380362.632732:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 81 00000100:00100000:3.0:1787380362.632741:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:11274:x1874203848520448:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787380362.632784:0:6523:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787380362.633081:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:11274:x1874203848520448:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 340us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380362.633089:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 81 00000100:00100000:2.0:1787380362.636211:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380362.636309:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848520704 00000100:00100000:0.0:1787380362.636317:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848520704 00000100:00100000:0.0:1787380362.636368:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 82 00000100:00100000:0.0:1787380362.636378:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:11274:x1874203848520704:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380362.636396:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380362.636399:0:10154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787380362.636426:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69283 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ace9 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.636443:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:0.0:1787380362.636448:0:10154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380362.636460:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692d7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0acfe expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787380362.636793:0:10154:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1787380362.636998:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad692de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.637010:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad692de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.637019:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad692de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.637069:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692d7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acfe expref: 62 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.637095:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad692de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acfe expref: 61 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.637102:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d6ec26f4100) 00010000:00010000:0.0:1787380362.637105:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380362.637107:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866a00, rc 0) 00000100:00100000:0.0:1787380362.637157:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+61:11274:x1874203848520704:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 780us (953us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787380362.637164:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 82 00000100:00100000:1.0:1787380362.644763:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380362.645061:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848520960 00000100:00100000:0.0:1787380362.645071:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848520960 00000100:00100000:0.0:1787380362.645127:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 83 00000100:00100000:0.0:1787380362.645136:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+61:11274:x1874203848520960:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787380362.645192:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380362.645216:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad692de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acfe expref: 61 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645232:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d6ec26f4100) 00010000:00010000:0.0:1787380362.645242:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380362.645261:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692ec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645275:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645284:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645307:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xd7a39035 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645315:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd7a39035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645322:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd7a39035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645369:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645375:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692ec lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645380:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645385:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380362.645389:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645397:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645404:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:0.0:1787380362.645407:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380362.645411:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692ec lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645417:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad692ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645433:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xd7a39035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645438:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692f3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd7a39035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645444:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd7a39035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645450:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380362.645453:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692f3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd7a39035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645459:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692f3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xd7a39035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645468:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xd7a39035 (ffff9d6ec26f4300) 00010000:00010000:0.0:1787380362.645470:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380362.645473:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692f3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd7a39035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.645478:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad692f3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xd7a39035 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380362.645557:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:11274:x1874203848520960:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 421us (803us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787380362.645565:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 83 00000100:00100000:1.0:1787380362.647552:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380362.647632:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848521088 00000100:00100000:2.0:1787380362.647641:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848521088 00000100:00100000:2.0:1787380362.647709:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 84 00000100:00100000:2.0:1787380362.647719:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:11274:x1874203848521088:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380362.647746:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380362.647766:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad692fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad05 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.647834:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad69301 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.647849:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad69301 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.647859:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad69301 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.647973:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad692fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad05 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.647989:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad69301 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad05 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.647997:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:2.0:1787380362.647999:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787380362.648002:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0fa00, rc 0) 00000100:00100000:2.0:1787380362.648054:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+61:11274:x1874203848521088:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 336us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380362.648061:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 84 00000100:00100000:2.0:1787380362.664050:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380362.664133:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848521344 00000100:00100000:0.0:1787380362.664142:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848521344 00000100:00100000:0.0:1787380362.664200:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 85 00000100:00100000:0.0:1787380362.664228:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+61:11274:x1874203848521344:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787380362.664301:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69308 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.664317:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.664332:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787380362.664491:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1787380362.664500:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372988690304ns, next at 373988688559ns, rc = 0 00000004:00010000:0.0:1787380362.664545:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002251b91d reply state 000000009057194f transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.664558:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69308 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.664565:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:0.0:1787380362.664568:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787380362.664571:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787380362.664672:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+63:11274:x1874203848521344:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 445us (628us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787380362.664679:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 85 00000100:00100000:1.0:1787380362.683619:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380362.686597:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848521472 00000100:00100000:2.0:1787380362.686610:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848521472 00000100:00100000:2.0:1787380362.687010:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 86 00000100:00100000:2.0:1787380362.687022:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+63:11274:x1874203848521472:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380362.687048:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380362.687067:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6930f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad0c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.687117:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6930f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad0c expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.687132:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6930f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad0c expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.687150:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:2.0:1787380362.687153:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787380362.687157:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0e600, rc 0) 00000100:00100000:2.0:1787380362.687214:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+64:11274:x1874203848521472:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 194us (3604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380362.695904:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380362.696091:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848521600 00000100:00100000:3.0:1787380362.696100:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848521600 00000100:00100000:3.0:1787380362.696149:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 32 00000100:00100000:3.0:1787380362.696159:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2396:x1874203848521600:12345-192.168.206.30@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787380362.696203:0:8435:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:3.0:1787380362.696235:0:8435:0:(genops.c:1406:class_connect()) connect: client 7da54272-8859-4cb3-ba98-d1d4e18c7c38, cookie 0xcf3c46fdcad69316 00002000:00100000:3.0:1787380362.696247:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7da54272-8859-4cb3-ba98-d1d4e18c7c38/ffff9d6fff73a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787380362.696257:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787380362.696329:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787380362.696356:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9d6fff739000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787380362.696413:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2396:x1874203848521600:12345-192.168.206.30@tcp:8:lhsmtool_posix.0 Request processed in 254us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380362.696421:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 32 00000100:00100000:1.0:1787380362.700990:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380362.701126:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848521728 00000100:00100000:3.0:1787380362.701135:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848521728 00000100:00100000:3.0:1787380362.701219:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:3.0:1787380362.701230:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:0:x1874203848521728:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787380362.701989:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380362.706499:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 86 00000001:00080000:3.0:1787380362.710025:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:3.0:1787380362.710039:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000100:00100000:1.0:1787380362.710230:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:0:x1874203848521728:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 8997us (9244us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787380362.710241:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:1.0:1787380362.712540:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380362.712791:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848521984 00000100:00100000:0.0:1787380362.712952:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848521984 00000100:00100000:0.0:1787380362.713051:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:0.0:1787380362.713061:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+64:11274:x1874203848521984:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787380362.713267:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+65:11274:x1874203848521984:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 207us (735us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1787380362.713287:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:2.0:1787380362.728041:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380362.728124:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848522240 00000100:00100000:0.0:1787380362.728133:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848522240 00000100:00100000:0.0:1787380362.728196:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 87 00000100:00100000:0.0:1787380362.728205:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+65:11274:x1874203848522240:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787380362.728418:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+65:11274:x1874203848522240:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 213us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380362.728426:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 87 00000100:00100000:3.0:1787380362.732307:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380362.732736:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848522368 00000100:00100000:0.0:1787380362.732746:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848522368 00000100:00100000:0.0:1787380362.732829:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 88 00000100:00100000:0.0:1787380362.732841:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+65:11274:x1874203848522368:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380362.732861:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380362.732880:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6931d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad13 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.732950:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69324 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.732963:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69324 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.732974:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69324 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380362.733016:0:10154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787380362.733032:0:10154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69324 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.733066:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6931d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad13 expref: 67 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.733088:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69324 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad13 expref: 66 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.733096:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:0.0:1787380362.733099:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787380362.733102:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866a00, rc 0) 00000100:00100000:0.0:1787380362.733332:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+66:11274:x1874203848522368:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 492us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380362.733339:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 88 00000100:00100000:3.0:1787380362.757095:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380362.757259:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848522496 00000100:00100000:2.0:1787380362.757268:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848522496 00000100:00100000:2.0:1787380362.757382:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00100000:2.0:1787380362.757393:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848522496:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380362.757409:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380362.757435:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055c3d6c1/0xcf3c46fdcad6932b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad1a expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787380362.757458:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a89428b, blocks: 0x0 00010000:00010000:2.0:1787380362.757476:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=373s v=(0 0) 00010000:00010000:2.0:1787380362.757480:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380362.757489:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055c3d6c1/0xcf3c46fdcad6932b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad1a expref: 6 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.757507:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000055c3d6c1/0xcf3c46fdcad6932b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad1a expref: 6 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.757521:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0fe00, rc 0) 00000100:00100000:2.0:1787380362.757613:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2398:x1874203848522496:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 222us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380362.757620:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00100000:0.0:1787380362.763492:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380362.763603:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848522752 00000100:00100000:3.0:1787380362.763613:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848522752 00000100:00100000:3.0:1787380362.763832:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 89 00000100:00100000:3.0:1787380362.763844:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+66:11274:x1874203848522752:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787380362.763944:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+66:11274:x1874203848522752:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 103us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380362.765056:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 89 00000100:00100000:3.0:1787380362.772051:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380362.773056:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848522880 00000100:00100000:1.0:1787380362.773067:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848522880 00000100:00100000:1.0:1787380362.773118:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 35 00000100:00100000:1.0:1787380362.773129:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:11274:x1874203848522880:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787380362.773146:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380362.773963:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000514ad7d4/0xcf3c46fdcad69332 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad21 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.773998:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000055c3d6c1/0xcf3c46fdcad6932b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad1a expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.774006:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380362.774010:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380362.774014:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000514ad7d4/0xcf3c46fdcad69332 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad21 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.774045:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000055c3d6c1/0xcf3c46fdcad6932b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad1a expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.774059:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000055c3d6c1/0xcf3c46fdcad6932b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad1a expref: 7 pid: 8433 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380362.774072:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1874203867476864:192.168.206.30@tcp:104: 00000100:00100000:1.0:1787380362.774159:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc3ebc480 going to sleep for 11 seconds 00000100:00100000:2.0:1787380362.785513:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380362.785602:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c9a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1874203867476864:192.168.206.30@tcp:104: 00010000:00010000:1.0:1787380362.785633:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000514ad7d4/0xcf3c46fdcad69332 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad21 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.785652:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc165ba00, rc 0) 00000100:00100000:1.0:1787380362.785722:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:11274:x1874203848522880:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 12595us (13679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380362.785741:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 35 00000100:00100000:0.0:1787380362.785886:0:10339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848523008 00000100:00100000:0.0:1787380362.785893:0:10339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848523008 00010000:00010000:0.0:1787380362.785930:0:10339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000055c3d6c1/0xcf3c46fdcad6932b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad1a expref: 7 pid: 8433 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380362.785957:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 59 00000100:00100000:0.0:1787380362.785966:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2399:x1874203848523008:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380362.785977:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380362.785994:0:10339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000055c3d6c1/0xcf3c46fdcad6932b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad1a expref: 7 pid: 8433 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.786007:0:10339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000055c3d6c1/0xcf3c46fdcad6932b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad1a expref: 7 pid: 8433 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.786035:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055c3d6c1/0xcf3c46fdcad6932b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad1a expref: 7 pid: 8433 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.786048:0:10339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380362.786052:0:10339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380362.786059:0:10339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000514ad7d4/0xcf3c46fdcad69332 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad21 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.786067:0:10339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000514ad7d4/0xcf3c46fdcad69332 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad21 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.786097:0:10339:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000514ad7d4/0xcf3c46fdcad69332 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad21 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380362.786111:0:10339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10339:1874203867476992:192.168.206.30@tcp:105: 00000100:00100000:0.0:1787380362.786157:0:10339:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3d75900 going to sleep for 11 seconds 00000100:00100000:0.0:1787380362.803239:0:10339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10339:1874203867476992:192.168.206.30@tcp:105: 00010000:00010000:0.0:1787380362.803261:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380362.803323:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2399:x1874203848523008:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 17358us (17817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380362.803335:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 59 00000100:00100000:1.0:1787380362.803586:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380362.803638:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848523136 00000100:00100000:0.0:1787380362.803644:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848523136 00002000:00100000:0.0:1787380362.803699:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9d6ec3c9a680 x1874203848523136/t0(0) o4->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:168/0 lens 504/0 e 0 to 0 dl 1787380373 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380362.803722:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec3c9a680 with x1874203848523136 ext(0->8) 00002000:00010000:0.0:1787380362.803727:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d6ec3c9a680 00000100:00100000:0.0:1787380362.803754:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:0.0:1787380362.803763:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2399:x1874203848523136:12345-192.168.206.30@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787380362.807139:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2399:x1874203848523136:12345-192.168.206.30@tcp:4:lhsmtool_posix.0 Request processed in 3367us (3544us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787380362.807152:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 0 00002000:00100000:0.0:1787380362.807163:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9d6ec3c9a680 x1874203848523136/t4294967303(0) o4->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:168/0 lens 504/448 e 0 to 0 dl 1787380373 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380362.807185:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec3c9a680 with x1874203848523136 ext(0->8) 00002000:00010000:0.0:1787380362.807192:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d6ec3c9a680 00000100:00100000:1.0:1787380362.810383:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380362.817752:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848523264 00000100:00100000:2.0:1787380362.817765:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848523264 00000100:00100000:2.0:1787380362.817851:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 90 00000100:00100000:2.0:1787380362.817863:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+66:11274:x1874203848523264:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787380362.821430:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1787380362.821442:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:3.0:1787380362.821477:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:2.0:1787380362.821577:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787380362.821595:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867477120:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787380362.821656:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380362.821715:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867477120 00000100:00100000:2.0:1787380362.821722:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867477120 00000100:00100000:2.0:1787380362.821761:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787380362.821778:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867477120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1787380362.821945:0:12152:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787380362.821949:0:12152:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787380363 00002000:00010000:2.0:1787380362.821951:0:12152:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787380362.821954:0:12152:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787380363 -> 1787380363 00002000:00010000:2.0:1787380362.821956:0:12152:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787380362.821993:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3641:x1874203867477120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 216us (336us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787380362.822001:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000004:00080000:2.0:1787380362.822043:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6ec3d05880/2, rc 0, transno 4294967304 00000100:00100000:2.0:1787380362.822049:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867477120:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1787380362.826293:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6904c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826417:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6904c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826425:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6904c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826430:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380362.826435:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6904c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826443:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6904c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826458:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9d6ec25aa500) 00010000:00010000:1.0:1787380362.826461:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380362.826466:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6904c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826472:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6904c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826493:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad69053 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826500:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad69053 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826518:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad69053 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826523:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380362.826526:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad69053 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826532:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad69053 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826540:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:1.0:1787380362.826542:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380362.826545:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad69053 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826551:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46400/0xcf3c46fdcad69053 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826568:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad69092 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826575:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad69092 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826581:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad69092 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826586:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380362.826590:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad69092 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826606:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad69092 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826615:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec25aa200) 00010000:00010000:1.0:1787380362.826617:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380362.826620:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad69092 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826626:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad69092 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826643:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6919c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826649:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6919c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826656:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6919c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826779:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0fc00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380362.826784:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6919c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.826791:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6919c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.827787:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:1.0:1787380362.827793:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380362.827949:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6919c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.827972:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6919c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.827989:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad691bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.827996:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad691bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.828002:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad691bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.828008:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fda000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380362.828012:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad691bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.828018:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad691bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.828028:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:1.0:1787380362.828030:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380362.828033:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad691bf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.828038:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad691bf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.828047:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69205 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.828052:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69205 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.828066:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69205 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.828071:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fda600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380362.828074:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69205 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.828080:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69205 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.828088:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:1.0:1787380362.828091:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380362.828093:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69205 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.828099:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69205 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.828110:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69308 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.828116:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69308 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.828122:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69308 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.828127:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380362.828130:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69308 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.828145:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69308 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.828154:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:1.0:1787380362.828156:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787380362.828159:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69308 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.828771:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69308 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787380362.829076:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1787380362.829087:0:6500:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d6fd2415cc0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787380362.829091:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ffc910f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d6fd2415240 00000020:00080000:3.0:1787380362.829095:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ffc910800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d6ec20b2200 00000100:00100000:0.0:1787380362.829296:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867477248:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787380362.829364:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1787380362.831507:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:3.0:1787380362.835282:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867477248 00000100:00100000:3.0:1787380362.835295:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867477248 00000100:00100000:3.0:1787380362.835370:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787380362.835380:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1874203867477248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787380362.835407:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1787380362.835436:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a894288, atime: 0x6a894289, ctime: 0x6a894288, blocks: 0x8 00010000:00010000:3.0:1787380362.835452:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a9050a8/0xcf3c46fdcad69339 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.835466:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=373s v=(0 0) 00010000:00010000:3.0:1787380362.835470:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380362.835475:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a9050a8/0xcf3c46fdcad69339 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.835487:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a9050a8/0xcf3c46fdcad69339 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.835496:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a9050a8/0xcf3c46fdcad69339 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.835502:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a9050a8/0xcf3c46fdcad69339 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.835519:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787380362.835682:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3639:x1874203867477248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 303us (6317us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787380362.836003:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:3.0:1787380362.836035:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380362.836040:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a9050a8/0xcf3c46fdcad69339 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.836048:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdaa00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:3.0:1787380362.836053:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a9050a8/0xcf3c46fdcad69339 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.836068:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a9050a8/0xcf3c46fdcad69339 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.836084:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a9050a8/0xcf3c46fdcad69339 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.836091:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a9050a8/0xcf3c46fdcad69339 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.836108:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380362.836110:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380362.836112:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787380362.836143:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6ec310a680/2, rc 0, transno 4294967302 00000100:00100000:3.0:1787380362.836149:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867477248:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1787380362.836390:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00080000:0.0:1787380362.836518:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787380362.838417:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+14:11274:x1874203848523264:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 Request processed in 20549us (28033us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380362.838430:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 90 00000100:00100000:1.0:1787380362.857390:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380362.860136:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848523392 00000100:00100000:2.0:1787380362.860149:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848523392 00000100:00100000:2.0:1787380362.860455:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 38 00000100:00100000:2.0:1787380362.860466:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2397:x1874203848523392:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787380362.864082:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1787380362.864094:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1787380362.864246:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2397:x1874203848523392:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 Request processed in 3777us (6858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380362.864258:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 38 00000100:00100000:0.0:1787380362.878484:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380362.878518:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848523648 00000100:00100000:0.0:1787380362.878527:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848523648 00000100:00100000:0.0:1787380362.878574:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 91 00000100:00100000:0.0:1787380362.878583:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+14:11274:x1874203848523648:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787380362.878628:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380362.878658:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69324 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad13 expref: 14 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.878686:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:0.0:1787380362.879255:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380362.879283:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69340 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.879297:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69340 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.879317:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69340 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787380362.879417:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ebdf7847 reply state 000000008ea33f00 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69340 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.879429:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69340 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.879435:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:0.0:1787380362.879438:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787380362.879440:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787380362.879518:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+15:11274:x1874203848523648:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 935us (1041us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1787380362.879526:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 91 00000100:00100000:1.0:1787380362.886102:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380362.886188:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848523776 00000100:00100000:3.0:1787380362.886197:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848523776 00000100:00100000:3.0:1787380362.886252:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 39 00000100:00100000:3.0:1787380362.886260:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2400:x1874203848523776:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787380362.886564:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787380362.886568:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787380363 -> 1787380362 00002000:00010000:3.0:1787380362.886570:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787380361 00002000:00010000:3.0:1787380362.886572:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787380363 -> 1787380362 00002000:00010000:3.0:1787380362.886575:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787380362.886646:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2400:x1874203848523776:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 385us (550us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787380362.886654:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 39 00000100:00100000:1.0:1787380362.888879:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380362.888975:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848524032 00000100:00100000:0.0:1787380362.888984:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848524032 00000100:00100000:0.0:1787380362.889026:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 92 00000100:00100000:0.0:1787380362.889035:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+15:11274:x1874203848524032:12345-192.168.206.30@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787380362.889112:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69347 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.889127:0:10154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad69301 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad05 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.889135:0:10154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69347 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.889175:0:10154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad69301 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad05 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.889189:0:10154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad69301 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad05 expref: 15 pid: 6522 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380362.889204:0:10154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10154:1874203867477376:192.168.206.30@tcp:104: 00000100:00100000:0.0:1787380362.889275:0:10154:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3d75f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380362.892029:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380362.892128:0:10154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d7bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10154:1874203867477376:192.168.206.30@tcp:104: 00010000:00010000:1.0:1787380362.892152:0:10154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69347 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380362.892271:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848524160 00000100:00100000:3.0:1787380362.892278:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848524160 00010000:00010000:3.0:1787380362.892318:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad69301 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad05 expref: 16 pid: 6522 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380362.892350:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 60 00000100:00100000:3.0:1787380362.892359:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+16:2399:x1874203848524160:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380362.892371:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380362.892377:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad69301 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad05 expref: 16 pid: 6522 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.892388:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad69301 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad05 expref: 16 pid: 6522 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.892409:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad69301 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad05 expref: 16 pid: 6522 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.892422:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:3.0:1787380362.892427:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69347 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.892437:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69347 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.892444:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69347 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.892496:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380362.892542:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+15:2399:x1874203848524160:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 183us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380362.892549:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 60 00010000:00010000:1.0:1787380362.892801:0:10154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69347 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.892831:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69347 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.892868:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69347 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.892876:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69347 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.892889:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69347 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.892895:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380362.892900:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69347 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.892907:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69347 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.892927:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:1.0:1787380362.892931:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787380362.892934:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69347 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.892941:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69347 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380362.892988:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+14:11274:x1874203848524032:12345-192.168.206.30@tcp:55:lhsmtool_posix.0 Request processed in 3954us (4116us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787380362.892996:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 92 00000100:00100000:0.0:1787380362.896332:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380362.896437:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848524288 00000100:00100000:3.0:1787380362.896446:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848524288 00000100:00100000:3.0:1787380362.896495:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 40 00000100:00100000:3.0:1787380362.896503:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2400:x1874203848524288:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787380362.896539:0:8871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5b027aa/0xcf3c46fdcad6934e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.896556:0:8871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000514ad7d4/0xcf3c46fdcad69332 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad21 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.896563:0:8871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380362.896567:0:8871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787380362.896571:0:8871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b027aa/0xcf3c46fdcad6934e lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.896598:0:8871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000514ad7d4/0xcf3c46fdcad69332 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad21 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.896610:0:8871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000514ad7d4/0xcf3c46fdcad69332 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad21 expref: 7 pid: 8436 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380362.896623:0:8871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3e9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8871:1874203867477504:192.168.206.30@tcp:104: 00000100:00100000:3.0:1787380362.896929:0:8871:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec2779540 going to sleep for 11 seconds 00000100:00100000:1.0:1787380362.906900:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380362.906936:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848524416 00000100:00100000:1.0:1787380362.906944:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848524416 00010000:00010000:1.0:1787380362.906978:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000514ad7d4/0xcf3c46fdcad69332 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad21 expref: 8 pid: 8436 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380362.907010:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 61 00000100:00100000:1.0:1787380362.907019:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2400:x1874203848524416:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380362.907045:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380362.907064:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000514ad7d4/0xcf3c46fdcad69332 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad21 expref: 8 pid: 8436 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.907076:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000514ad7d4/0xcf3c46fdcad69332 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad21 expref: 8 pid: 8436 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.907099:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787380362.907103:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787380362.907108:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5b027aa/0xcf3c46fdcad6934e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.907118:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b027aa/0xcf3c46fdcad6934e lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.907136:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380362.907195:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2400:x1874203848524416:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 177us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380362.907203:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 61 00010000:00010000:0.0:1787380362.907383:0:8871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000514ad7d4/0xcf3c46fdcad69332 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad21 expref: 7 pid: 8436 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380362.907398:0:8871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3e9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8871:1874203867477504:192.168.206.30@tcp:104: 00010000:00010000:0.0:1787380362.907415:0:8871:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5b027aa/0xcf3c46fdcad6934e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.907425:0:8871:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5b027aa/0xcf3c46fdcad6934e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.907439:0:8871:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b027aa/0xcf3c46fdcad6934e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.907471:0:8871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b5b027aa/0xcf3c46fdcad6934e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.907478:0:8871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b027aa/0xcf3c46fdcad6934e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.907487:0:8871:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b027aa/0xcf3c46fdcad6934e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.907493:0:8871:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdb200 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380362.907497:0:8871:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b027aa/0xcf3c46fdcad6934e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.907505:0:8871:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b027aa/0xcf3c46fdcad6934e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.907516:0:8871:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b027aa/0xcf3c46fdcad6934e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380362.907523:0:8871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b027aa/0xcf3c46fdcad6934e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380362.907585:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2400:x1874203848524288:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 Request processed in 11083us (11262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380362.907594:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 40 00000100:00100000:1.0:1787380362.911596:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380362.911723:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848524672 00000100:00100000:3.0:1787380362.911744:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848524672 00000100:00100000:3.0:1787380362.911801:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 93 00000100:00100000:3.0:1787380362.911835:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+14:11274:x1874203848524672:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787380362.911907:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69355 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.911935:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69195 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acaa expref: 14 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.911946:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69355 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.911977:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69195 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acaa expref: 14 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.911990:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69195 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acaa expref: 14 pid: 10154 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380362.912005:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3e9d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867477632:192.168.206.30@tcp:104: 00000100:00100000:3.0:1787380362.912075:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec2779300 going to sleep for 11 seconds 00000100:00100000:1.0:1787380362.918193:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380362.918986:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848524800 00000100:00100000:2.0:1787380362.918996:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848524800 00010000:00010000:2.0:1787380362.919033:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69195 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acaa expref: 15 pid: 10154 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380362.919076:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 62 00000100:00100000:2.0:1787380362.919086:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc8e88450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+15:2400:x1874203848524800:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380362.919099:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380362.919116:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69195 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acaa expref: 15 pid: 10154 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.919129:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69195 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acaa expref: 15 pid: 10154 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.919150:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:2.0:1787380362.919155:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69355 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.919165:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69355 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.919173:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69355 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.919189:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380362.919242:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc8e88450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+15:2400:x1874203848524800:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 157us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380362.919250:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 62 00010000:00010000:3.0:1787380362.924270:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69195 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acaa expref: 14 pid: 10154 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380362.924295:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3e9d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867477632:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380362.924327:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69355 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.924558:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69355 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.924566:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69355 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.924737:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad6935c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.924749:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6930f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad0c expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.924768:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad6935c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.924801:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6930f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad0c expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.924844:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6930f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad0c expref: 14 pid: 6522 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380362.924858:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867477760:192.168.206.30@tcp:104: 00000100:00100000:2.0:1787380362.925040:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76300 going to sleep for 11 seconds 00000100:00100000:1.0:1787380362.938803:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380362.938928:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848524928 00000100:00100000:3.0:1787380362.938937:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848524928 00010000:00010000:3.0:1787380362.938972:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6930f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad0c expref: 15 pid: 6522 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380362.939017:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 63 00000100:00100000:3.0:1787380362.939028:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+15:2399:x1874203848524928:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380362.939043:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380362.939050:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6930f lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad0c expref: 15 pid: 6522 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.939064:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6930f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad0c expref: 15 pid: 6522 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.939085:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:3.0:1787380362.939091:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad6935c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.939100:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad6935c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.939107:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad6935c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.939124:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380362.939182:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+15:2399:x1874203848524928:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 155us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380362.939189:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 63 00010000:00010000:2.0:1787380362.939525:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6930f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad0c expref: 14 pid: 6522 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380362.939540:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867477760:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380362.939558:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad6935c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.939566:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad6935c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380362.939571:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad6935c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787380362.939662:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1787380362.939778:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1787380362.939945:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1787380362.940023:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874203867477888:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787380362.940063:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380362.940184:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76900 going to sleep for 11 seconds 00000100:00100000:1.0:1787380362.940792:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867477888 00000100:00100000:1.0:1787380362.940799:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867477888 00000100:00100000:1.0:1787380362.940859:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787380362.940869:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1874203867477888:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787380362.942307:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1874203867477888:12345-0@lo:1000:mdt00_002.0 Request processed in 1435us (2237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380362.942319:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787380362.942401:0:6523:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787380362.942412:0:6523:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6ec3d05880, transno 4294967304 00000100:00100000:1.0:1787380362.942474:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874203867477888:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787380362.942595:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1787380362.942653:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874203867478016:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787380362.942690:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380362.942711:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4ec0600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380362.943047:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867478016 00000100:00100000:3.0:1787380362.943052:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867478016 00000100:00100000:3.0:1787380362.943081:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787380362.943089:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1874203867478016:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787380362.943202:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6523:x1874203867478016:12345-0@lo:1000:mdt00_002.0 Request processed in 113us (511us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787380362.943208:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787380362.943291:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c9b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874203867478016:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787380362.943324:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad6935c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.943334:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad6935c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.943341:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad6935c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.943347:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0f200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380362.943351:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad6935c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.943358:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad6935c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.943372:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:1.0:1787380362.943375:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787380362.943379:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad6935c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.943385:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad6935c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.943424:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad6928a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.943430:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad6928a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.943436:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad6928a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.943441:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165ac00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380362.943444:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad6928a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.943450:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad6928a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.943459:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:1.0:1787380362.943461:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787380362.943463:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad6928a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.943468:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad6928a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.943511:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69363 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.943524:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad692a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acf0 expref: 17 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.943532:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69363 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.943558:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad692a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acf0 expref: 17 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.943571:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad692a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acf0 expref: 17 pid: 10154 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380362.943581:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867478144:192.168.206.30@tcp:104: 00000100:00100000:1.0:1787380362.943675:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5d58e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787380362.954630:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380362.955369:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867478144:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380362.955395:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69363 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380362.955605:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848525056 00000100:00100000:3.0:1787380362.955613:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848525056 00010000:00010000:3.0:1787380362.955646:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad692a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acf0 expref: 18 pid: 10154 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380362.960954:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 64 00000100:00100000:3.0:1787380362.960977:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:2399:x1874203848525056:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380362.960998:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380362.961023:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad692a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acf0 expref: 18 pid: 10154 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.961041:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad692a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acf0 expref: 18 pid: 10154 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.961061:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad692a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0acf0 expref: 18 pid: 10154 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.961078:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:3.0:1787380362.961083:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69363 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.961113:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69363 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.961120:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69363 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380362.961266:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380362.961325:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+17:2399:x1874203848525056:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 357us (6703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380362.961332:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 64 00010000:00010000:1.0:1787380362.965479:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69363 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.965496:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69363 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.965510:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69363 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.965516:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69363 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.965523:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69363 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.965529:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165ae00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380362.965533:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69363 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.965539:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69363 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.965572:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:1.0:1787380362.965575:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380362.965579:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69363 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.965585:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69363 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.965601:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69355 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.968267:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69355 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.968277:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69355 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.968284:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdaa00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380362.968288:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69355 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.968296:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69355 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.968310:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec241b200) 00010000:00010000:1.0:1787380362.968313:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787380362.968316:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69355 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.968323:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad69355 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380362.968672:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+16:11274:x1874203848524672:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 56859us (57080us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1787380362.968683:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 93 00000020:00080000:0.0:1787380362.968689:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787380362.968831:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787380362.968836:0:13800:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787380362.968853:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787380362.968859:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787380362.986749:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380362.986784:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848525312 00000100:00100000:1.0:1787380362.986792:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848525312 00000100:00100000:1.0:1787380362.986855:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:1.0:1787380362.986865:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+16:11274:x1874203848525312:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787380362.987097:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787380362.987126:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1787380362.987157:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad6936a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.987172:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad6936a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.987183:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad6936a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.987191:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad6936a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.987197:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad6936a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.987203:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad6936a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.987218:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787380362.987292:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:11274:x1874203848525312:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 428us (550us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1787380362.987999:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 20 00000020:00080000:1.0:1787380362.989242:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787380362.989271:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380362.989289:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad6936a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.989299:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165ae00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380362.989303:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad6936a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.989312:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad6936a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.989334:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:1.0:1787380362.989337:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787380362.989342:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad6936a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.989348:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad6936a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380362.989359:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380362.989361:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380362.989362:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380363.342025:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380363.407683:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867478272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787380363.407759:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380363.410510:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867478272 00000100:00100000:0.0:1787380363.410522:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867478272 00000100:00100000:0.0:1787380363.410582:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787380363.410593:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867478272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787380363.410626:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1787380363.410699:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867478272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (2940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380363.410707:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787380363.411183:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867478272:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1787380363.503483:0:14215:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787380363.503502:0:14215:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787380363.503790:0:14215:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787380363.503797:0:14215:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787380363.575352:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380363.575454:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848525568 00000100:00100000:1.0:1787380363.575464:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848525568 00000100:00100000:1.0:1787380363.575522:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 94 00000100:00100000:1.0:1787380363.575532:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:11294:x1874203848525568:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1787380363.575566:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380363.575583:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ba00/0xcf3c46fdcad69371 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad28 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.575681:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69378 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.575798:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69378 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.575840:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69378 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380363.575854:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1787380363.575958:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ba00/0xcf3c46fdcad69371 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad28 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.575975:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69378 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad28 expref: 20 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.575984:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:1.0:1787380363.575987:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787380363.575991:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fc165ae00, rc 0) 00000100:00100000:1.0:1787380363.576047:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+20:11294:x1874203848525568:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 512us (698us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1787380363.576054:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 94 00000100:00100000:3.0:1787380363.578347:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380363.578442:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848525696 00000100:00100000:0.0:1787380363.578451:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848525696 00000100:00100000:0.0:1787380363.578505:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 95 00000100:00100000:0.0:1787380363.578515:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+20:11294:x1874203848525696:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:0.0:1787380363.578587:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69386 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578601:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69386 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578611:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69386 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578624:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6938d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578631:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6938d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578638:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6938d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578721:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69394 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578729:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69394 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578736:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69394 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787380363.578774:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69394 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578787:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69386 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578802:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69386 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578828:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69386 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578835:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380363.578839:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69386 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578846:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69386 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578856:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:0.0:1787380363.578858:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380363.578862:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69386 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578867:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69386 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578878:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6938d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578884:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6938d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578890:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6938d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578894:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380363.578903:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6938d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578919:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6938d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578928:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec26f4100) 00010000:00010000:0.0:1787380363.578930:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380363.578933:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6938d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578939:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6938d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578953:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69394 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578958:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69394 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578964:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69394 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578969:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380363.578972:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69394 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578978:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69394 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.578984:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec26f4700) 00010000:00010000:0.0:1787380363.578987:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380363.578995:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69394 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.579001:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69394 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380363.579066:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+20:11294:x1874203848525696:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 552us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380363.579073:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 95 00000100:00100000:0.0:1787380363.614522:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380363.614594:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848525952 00000100:00100000:1.0:1787380363.614603:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848525952 00000100:00100000:1.0:1787380363.614656:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 96 00000100:00100000:1.0:1787380363.614671:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+20:11297:x1874203848525952:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1787380363.614689:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380363.614705:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ba00/0xcf3c46fdcad6939b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad2f expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.614766:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad693a2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.614778:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad693a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.614788:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad693a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.614800:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad693a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.614838:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad693a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.614847:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad693a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.614970:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad693b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.614978:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad693b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.614985:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad693b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380363.615005:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787380363.615069:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad693a2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.615076:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad693a2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.615083:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad693a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.615088:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165ac00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380363.615092:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad693a2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.615099:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad693a2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.615109:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:1.0:1787380363.615112:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380363.615116:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad693a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.615122:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ac00/0xcf3c46fdcad693a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.615133:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad693a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.615139:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad693a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.615154:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad693a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.615159:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165b000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380363.615162:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad693a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.615168:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad693a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.615174:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec3030500) 00010000:00010000:1.0:1787380363.615177:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380363.615179:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad693a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.615184:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165b000/0xcf3c46fdcad693a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.615214:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ba00/0xcf3c46fdcad6939b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad2f expref: 23 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.615225:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad693b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad2f expref: 22 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.615233:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec3030100) 00010000:00010000:1.0:1787380363.615235:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380363.615237:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df1c00, rc 0) 00000100:00100000:1.0:1787380363.615292:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:11297:x1874203848525952:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 622us (777us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787380363.615306:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 96 00000100:00100000:3.0:1787380363.640572:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380363.640805:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848526080 00000100:00100000:1.0:1787380363.640884:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848526080 00000100:00100000:0.0:1787380363.641172:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 97 00000100:00100000:0.0:1787380363.641183:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:11297:x1874203848526080:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:0.0:1787380363.641266:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad693be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.641282:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad693be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.641294:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad693be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.641327:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad693be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.641334:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad693be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.641340:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad693be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.641346:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380363.641358:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad693be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.641366:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad693be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.641377:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec3030100) 00010000:00010000:0.0:1787380363.641380:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787380363.641384:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad693be lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.641390:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad693be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380363.641486:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:11297:x1874203848526080:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 304us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380363.641494:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 97 00000100:00100000:0.0:1787380363.643273:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380363.644453:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848526336 00000100:00100000:2.0:1787380363.644463:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848526336 00000100:00100000:2.0:1787380363.644523:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:2.0:1787380363.644533:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7be3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:11297:x1874203848526336:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1787380363.644728:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7be3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+23:11297:x1874203848526336:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 196us (1459us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1787380363.644736:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:2.0:1787380363.686070:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380363.686771:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848526592 00000100:00100000:3.0:1787380363.686781:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848526592 00000100:00100000:3.0:1787380363.686852:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 98 00000100:00100000:3.0:1787380363.686860:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+23:10823:x1874203848526592:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:3.0:1787380363.686881:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380363.686898:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad693c5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad36 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.687004:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad693cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.687018:0:10154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad693b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad2f expref: 24 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.687026:0:10154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad693cc lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.687061:0:10154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad693b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad2f expref: 24 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.687074:0:10154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad693b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad2f expref: 24 pid: 10154 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380363.687086:0:10154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3e9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10154:1874203867478400:192.168.206.30@tcp:104: 00000100:00100000:3.0:1787380363.687173:0:10154:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec2779300 going to sleep for 11 seconds 00000100:00100000:1.0:1787380363.690711:0:10154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3e9c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10154:1874203867478400:192.168.206.30@tcp:104: 00010000:00010000:1.0:1787380363.690737:0:10154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad693cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380363.690975:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380363.691017:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848526720 00000100:00100000:1.0:1787380363.691023:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848526720 00010000:00010000:1.0:1787380363.691053:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad693b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad2f expref: 25 pid: 10154 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380363.691090:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 65 00000100:00100000:1.0:1787380363.691099:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+25:2400:x1874203848526720:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380363.691110:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380363.691116:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad693b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad2f expref: 25 pid: 10154 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.691127:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad693b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad2f expref: 25 pid: 10154 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.691146:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad693b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad2f expref: 25 pid: 10154 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.691158:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec3030100) 00010000:00010000:1.0:1787380363.691163:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad693cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.691178:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad693cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.691184:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad693cc lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380363.691203:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380363.691257:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+24:2400:x1874203848526720:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 159us (283us total) trans 0 rc 0/0 00010000:00010000:3.0:1787380363.691264:0:10154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad693cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380363.691265:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 65 00010000:00010000:3.0:1787380363.691275:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad693cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380363.691293:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787380363.691409:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad693c5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad36 expref: 25 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.691425:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad693cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad36 expref: 24 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.691433:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec3030100) 00010000:00010000:3.0:1787380363.691436:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787380363.691438:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fdbe00, rc 0) 00000100:00100000:3.0:1787380363.691475:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+24:10823:x1874203848526592:12345-192.168.206.30@tcp:101:bash.0 Request processed in 4615us (5412us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1787380363.691490:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 98 00000100:00100000:3.0:1787380363.693269:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380363.693329:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848526848 00000100:00100000:0.0:1787380363.693337:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848526848 00000100:00100000:0.0:1787380363.693439:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 99 00000100:00100000:0.0:1787380363.693450:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+24:10823:x1874203848526848:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1787380363.693468:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380363.693484:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad693da lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad3d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.693514:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad693e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.693524:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad693e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.693542:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad693e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.693629:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad693da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad3d expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.693645:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad693e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad3d expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.693654:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec3030100) 00010000:00010000:0.0:1787380363.693669:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787380363.693673:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867a00, rc 0) 00000100:00100000:0.0:1787380363.693723:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+25:10823:x1874203848526848:12345-192.168.206.30@tcp:101:bash.0 Request processed in 275us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380363.693730:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 99 00000100:00100000:1.0:1787380363.695895:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380363.699758:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848527104 00000100:00100000:3.0:1787380363.699773:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848527104 00000100:00100000:3.0:1787380363.699856:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 100 00000100:00100000:3.0:1787380363.699865:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+25:10823:x1874203848527104:12345-192.168.206.30@tcp:36:bash.0 00010000:00010000:3.0:1787380363.700090:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad693e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.700106:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad693e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.700117:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad693e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787380363.700154:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1787380363.700173:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ee2ddd72 reply state 00000000769135e5 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad693e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.700186:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad693e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.700193:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec3030100) 00010000:00010000:3.0:1787380363.700196:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787380363.700199:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787380363.700233:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1787380363.700331:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+29:10823:x1874203848527104:12345-192.168.206.30@tcp:36:bash.0 Request processed in 466us (4442us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787380363.700339:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 100 00000020:00080000:3.0:1787380363.700349:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787380363.702478:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380363.702570:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848527232 00000100:00100000:3.0:1787380363.702578:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848527232 00000100:00100000:3.0:1787380363.702627:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 101 00000100:00100000:3.0:1787380363.702636:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+29:10823:x1874203848527232:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:3.0:1787380363.702655:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380363.702681:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad693ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad44 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.702725:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad693ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad44 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.702737:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad693ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad44 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.702753:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec3030100) 00010000:00010000:3.0:1787380363.702756:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787380363.702759:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fdb200, rc 0) 00000100:00100000:3.0:1787380363.702805:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+30:10823:x1874203848527232:12345-192.168.206.30@tcp:101:bash.0 Request processed in 170us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380363.702829:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 101 00000100:00100000:0.0:1787380363.708220:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380363.708322:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848527360 00000100:00100000:2.0:1787380363.708331:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848527360 00000100:00100000:2.0:1787380363.708452:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 41 00000100:00100000:2.0:1787380363.708463:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:10823:x1874203848527360:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:2.0:1787380363.708479:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380363.708498:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad693f6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad4b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787380363.708526:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a89428a, atime: 0x6a894289, ctime: 0x6a89428a, blocks: 0x8 00010000:00010000:2.0:1787380363.708547:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=374s v=(0 0) 00010000:00010000:2.0:1787380363.708552:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380363.708560:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad693f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad4b expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380363.708577:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad693f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad4b expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380363.708590:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0e000, rc 0) 00000100:00100000:2.0:1787380363.708642:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:10823:x1874203848527360:12345-192.168.206.30@tcp:101:bash.0 Request processed in 181us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380363.708650:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 41 00000100:00100000:3.0:1787380363.710894:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380363.712050:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848527488 00000100:00100000:2.0:1787380363.712060:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848527488 00002000:00010000:2.0:1787380363.712097:0:8439:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1787380363.712102:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec3e9f100 with x1874203848527488 ext(0->18446744073709551615) 00002000:00010000:2.0:1787380363.712113:0:8439:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d6ec3e9f100. 00000100:00100000:2.0:1787380363.712149:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00100000:2.0:1787380363.712158:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2397:x1874203848527488:12345-192.168.206.30@tcp:10:bash.0 00002000:00010000:2.0:1787380363.712523:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787380363.712527:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1787380362 -> 1787380364 00002000:00010000:2.0:1787380363.712529:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1787380361 -> 1787380361 00002000:00010000:2.0:1787380363.712532:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1787380362 -> 1787380364 00002000:00010000:2.0:1787380363.712540:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1787380363.712598:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2397:x1874203848527488:12345-192.168.206.30@tcp:10:bash.0 Request processed in 441us (1712us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787380363.712606:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 1 00002000:00010000:2.0:1787380363.712610:0:8439:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1787380363.712613:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec3e9f100 with x1874203848527488 ext(0->18446744073709551615) 00002000:00010000:2.0:1787380363.712618:0:8439:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d6ec3e9f100. 00000100:00100000:2.0:1787380363.829087:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380363.829166:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848527616 00000100:00100000:3.0:1787380363.829174:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848527616 00000100:00100000:3.0:1787380363.829223:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 102 00000100:00100000:3.0:1787380363.829232:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+30:11311:x1874203848527616:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:3.0:1787380363.829289:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad693fd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829312:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad693fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829323:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad693fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829339:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69404 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829345:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69404 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829350:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69404 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829411:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6940b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829418:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6940b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829424:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6940b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787380363.829471:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6940b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829480:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad693fd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829486:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad693fd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829500:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad693fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829505:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdb600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380363.829509:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad693fd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829516:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad693fd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829527:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:3.0:1787380363.829530:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380363.829534:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad693fd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829539:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad693fd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829551:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69404 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829556:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69404 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829561:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69404 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829565:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fda600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380363.829568:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69404 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829580:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69404 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829586:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec241be00) 00010000:00010000:3.0:1787380363.829588:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380363.829590:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69404 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829594:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad69404 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829612:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6940b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829618:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6940b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829622:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6940b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829626:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fda000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380363.829629:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6940b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829634:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6940b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829641:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec3030100) 00010000:00010000:3.0:1787380363.829643:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380363.829646:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6940b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.829670:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6940b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380363.829743:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+30:11311:x1874203848527616:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 511us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380363.829751:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 102 00000100:00100000:3.0:1787380363.878728:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380363.879761:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848527872 00000100:00100000:0.0:1787380363.879772:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848527872 00000100:00100000:0.0:1787380363.879860:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 103 00000100:00100000:0.0:1787380363.879887:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+30:11314:x1874203848527872:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1787380363.879915:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380363.879934:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69412 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad52 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.879998:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69419 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880027:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69419 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880039:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69419 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880054:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69420 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880062:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69420 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880068:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69420 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880169:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69427 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880178:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69427 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880185:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69427 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380363.880194:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787380363.880261:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69419 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880268:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69419 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880274:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69419 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880284:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380363.880289:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69419 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880296:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69419 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880308:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:0.0:1787380363.880311:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380363.880315:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69419 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880321:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69419 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880335:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69420 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880341:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69420 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880346:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69420 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880351:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380363.880614:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69420 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880623:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69420 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880644:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec26f4700) 00010000:00010000:0.0:1787380363.880646:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380363.880649:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69420 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880655:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69420 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880693:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69412 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad52 expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880708:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69427 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad52 expref: 32 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.880715:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec3030100) 00010000:00010000:0.0:1787380363.880717:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787380363.880720:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866400, rc 0) 00000100:00100000:0.0:1787380363.880781:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+32:11314:x1874203848527872:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 896us (2061us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787380363.880789:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 103 00000100:00100000:0.0:1787380363.895803:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380363.896054:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848528000 00000100:00100000:3.0:1787380363.896063:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848528000 00000100:00100000:3.0:1787380363.896120:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 104 00000100:00100000:3.0:1787380363.896129:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+32:11314:x1874203848528000:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:3.0:1787380363.896193:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69435 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.896209:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad693cc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad36 expref: 32 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.896219:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69435 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.896251:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad693cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad36 expref: 32 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.896264:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad693cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad36 expref: 32 pid: 10154 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380363.896277:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3e9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874203867478528:192.168.206.30@tcp:104: 00000100:00100000:3.0:1787380363.896394:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec27793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380363.906330:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3e9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874203867478528:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380363.906356:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69435 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380363.916019:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380363.916342:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848528256 00000100:00100000:1.0:1787380363.916351:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848528256 00000100:00100000:1.0:1787380363.916405:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00100000:1.0:1787380363.916414:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+33:6166:x1874203848528256:12345-192.168.206.30@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787380363.916688:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+34:6166:x1874203848528256:12345-192.168.206.30@tcp:35:ldlm_bl.0 Request processed in 274us (676us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787380363.916697:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00100000:2.0:1787380363.919193:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380363.919549:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848528384 00000100:00100000:0.0:1787380363.919557:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848528384 00010000:00010000:0.0:1787380363.919592:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad693cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad36 expref: 34 pid: 10154 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380363.919630:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00100000:0.0:1787380363.919651:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+34:2399:x1874203848528384:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380363.919675:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380363.919683:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad693cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad36 expref: 34 pid: 10154 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.919696:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad693cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad36 expref: 34 pid: 10154 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.919717:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad693cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad36 expref: 34 pid: 10154 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.919733:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec3030100) 00010000:00010000:0.0:1787380363.919739:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69435 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.919749:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69435 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.919755:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69435 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380363.919787:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380363.919873:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+33:2399:x1874203848528384:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 223us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380363.919881:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 66 00010000:00010000:2.0:1787380363.920034:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69435 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380363.920042:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69435 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380363.920078:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69435 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380363.920084:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69435 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380363.920095:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69435 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380363.920100:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fda000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380363.920104:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69435 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380363.920110:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69435 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380363.920129:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec3030100) 00010000:00010000:2.0:1787380363.920131:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787380363.920135:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69435 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380363.920140:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69435 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380363.920188:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+32:11314:x1874203848528000:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 24061us (24394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380363.920196:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 104 00000100:00100000:2.0:1787380363.927002:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380363.927067:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848528640 00000100:00100000:0.0:1787380363.927075:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848528640 00000100:00100000:0.0:1787380363.927122:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:0.0:1787380363.927130:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+32:11314:x1874203848528640:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:0.0:1787380363.927333:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+33:11314:x1874203848528640:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 202us (338us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1787380363.927340:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:0.0:1787380363.993359:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380363.993448:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848528896 00000100:00100000:3.0:1787380363.993468:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848528896 00000100:00100000:3.0:1787380363.993523:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 105 00000100:00100000:3.0:1787380363.993533:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+33:11325:x1874203848528896:12345-192.168.206.30@tcp:101:cat.0 00010000:00010000:3.0:1787380363.993553:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380363.993571:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad6943c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad59 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.993633:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad69443 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.993646:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad69443 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.993655:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad69443 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.993670:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6944a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.993676:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6944a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.993682:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6944a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.993796:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad69451 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.993831:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad69451 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.993840:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad69451 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380363.993850:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787380363.993928:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad69443 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.993936:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad69443 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.993942:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad69443 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.993948:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdb600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380363.993952:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad69443 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.993959:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad69443 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.993971:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:3.0:1787380363.993974:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380363.993979:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad69443 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.993996:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad69443 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.994010:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6944a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.994016:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6944a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.994022:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6944a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.994027:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fda000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380363.994030:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6944a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.994036:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6944a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.994044:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec241be00) 00010000:00010000:3.0:1787380363.994046:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380363.994048:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6944a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.994053:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad6944a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.994102:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad6943c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad59 expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.994116:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad69451 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad59 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380363.994129:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec3030100) 00010000:00010000:3.0:1787380363.994131:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380363.994134:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fdbe00, rc 0) 00000100:00100000:3.0:1787380363.994199:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+35:11325:x1874203848528896:12345-192.168.206.30@tcp:101:cat.0 Request processed in 667us (848us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787380363.994208:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 105 00000100:00100000:2.0:1787380364.000050:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380364.000159:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848529152 00000100:00100000:0.0:1787380364.000167:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848529152 00000100:00100000:0.0:1787380364.000253:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:0.0:1787380364.000262:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+35:11325:x1874203848529152:12345-192.168.206.30@tcp:35:cat.0 00000100:00100000:0.0:1787380364.000584:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+36:11325:x1874203848529152:12345-192.168.206.30@tcp:35:cat.0 Request processed in 321us (541us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787380364.000592:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:2.0:1787380364.015083:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380364.015160:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848529408 00000100:00100000:3.0:1787380364.015168:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848529408 00000100:00100000:3.0:1787380364.015227:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 106 00000100:00100000:3.0:1787380364.015235:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+36:11326:x1874203848529408:12345-192.168.206.30@tcp:36:rm.0 00010000:00010000:3.0:1787380364.015281:0:10154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1787380364.015313:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb200/0xcf3c46fdcad693ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad44 expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015334:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbe00/0xcf3c46fdcad69451 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad59 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015345:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69427 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad52 expref: 34 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015356:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad693e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad3d expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015366:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec3030100) 00010000:00010000:3.0:1787380364.015370:0:10154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380364.015401:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad6945f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015414:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad6945f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015423:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad6945f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015436:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69466 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015443:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69466 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015450:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69466 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015523:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad6946d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015531:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad6946d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015538:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad6946d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787380364.015750:0:10154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1787380364.015760:0:10154:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 374339949826ns, next at 375339947508ns, rc = 0 00010000:00010000:3.0:1787380364.015802:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69474 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015861:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69474 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015876:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69474 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015883:0:10154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69474 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015888:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69474 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015894:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69474 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015921:0:10154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380364.015939:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad6946d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015945:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad6946d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015951:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad6946d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015956:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdb600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380364.015959:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad6946d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015966:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad6946d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015974:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec3030100) 00010000:00010000:3.0:1787380364.015977:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787380364.015985:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad6946d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.015991:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb600/0xcf3c46fdcad6946d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.016005:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad6945f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.016011:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad6945f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.016016:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad6945f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.016021:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fda600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380364.016024:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad6945f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.016030:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad6945f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.016039:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:3.0:1787380364.016041:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380364.016045:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad6945f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.016050:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda600/0xcf3c46fdcad6945f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787380364.016059:0:10154:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004a99e529 reply state 00000000c0a9ceb3 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69466 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.016081:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69466 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.016087:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec241be00) 00010000:00010000:3.0:1787380364.016090:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787380364.016092:0:10154:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380364.016155:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+34:11326:x1874203848529408:12345-192.168.206.30@tcp:36:rm.0 Request processed in 919us (1079us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787380364.016163:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 106 00010000:00010000:3.0:1787380364.016197:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380364.016202:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69474 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.016208:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89dc00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:3.0:1787380364.016212:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69474 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.016219:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69474 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.016227:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec3030100) 00010000:00010000:3.0:1787380364.016230:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787380364.016232:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69474 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.016238:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69474 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.016246:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380364.016248:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380364.016255:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787380364.016714:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380364.052587:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380364.052739:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848529664 00000100:00100000:0.0:1787380364.052747:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848529664 00000100:00100000:0.0:1787380364.052841:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 107 00000100:00100000:0.0:1787380364.052851:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+34:11332:x1874203848529664:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1787380364.052873:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380364.052890:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad6947b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad60 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.053217:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69482 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.053231:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69482 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.053242:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69482 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.053253:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad69489 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.053261:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad69489 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.053267:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad69489 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787380364.053571:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787380364.053751:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69490 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.053761:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69490 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.053768:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69490 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.053799:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69482 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.053805:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69482 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.053842:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69482 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.053847:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0e400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380364.053851:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69482 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.053857:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69482 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.053867:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:2.0:1787380364.053871:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380364.053875:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69482 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.053892:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69482 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380364.053916:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000062143c69 reply state 0000000083639db2 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad69489 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.053928:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad69489 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.053935:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec241be00) 00010000:00010000:2.0:1787380364.053937:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787380364.053940:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787380364.053967:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad6947b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad60 expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.053981:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69490 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad60 expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.053988:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6fc4767900) 00010000:00010000:2.0:1787380364.053990:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380364.053993:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0f000, rc 0) 00000100:00100000:2.0:1787380364.054058:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+37:11332:x1874203848529664:12345-192.168.206.30@tcp:101:bash.0 Request processed in 1208us (1478us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787380364.054066:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 107 00000100:00100000:2.0:1787380364.060432:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380364.060620:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848529792 00000100:00100000:3.0:1787380364.060630:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848529792 00000100:00100000:3.0:1787380364.060706:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00100000:3.0:1787380364.060716:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2397:x1874203848529792:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:3.0:1787380364.060731:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380364.060749:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072c433a9/0xcf3c46fdcad6949e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad67 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787380364.060772:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787380364.060790:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=374s v=(0 0) 00010000:00010000:3.0:1787380364.060794:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380364.060801:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072c433a9/0xcf3c46fdcad6949e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad67 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.060854:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000072c433a9/0xcf3c46fdcad6949e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad67 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.060867:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89dc00, rc 0) 00000100:00100000:3.0:1787380364.060926:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2397:x1874203848529792:12345-192.168.206.30@tcp:101:bash.0 Request processed in 211us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380364.060933:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00080000:0.0:1787380364.061048:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787380364.063735:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380364.063845:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848529920 00000100:00100000:3.0:1787380364.063854:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848529920 00000100:00100000:3.0:1787380364.063901:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 43 00000100:00100000:3.0:1787380364.063919:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:11332:x1874203848529920:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:3.0:1787380364.063946:0:8871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380364.063961:0:8871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068ef8694/0xcf3c46fdcad694a5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad6e expref: -99 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.063990:0:8871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000072c433a9/0xcf3c46fdcad6949e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad67 expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.064000:0:8871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380364.064003:0:8871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380364.064008:0:8871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068ef8694/0xcf3c46fdcad694a5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad6e expref: 9 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.064037:0:8871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000072c433a9/0xcf3c46fdcad6949e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad67 expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.064049:0:8871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000072c433a9/0xcf3c46fdcad6949e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad67 expref: 9 pid: 8433 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380364.064062:0:8871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3e9fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8871:1874203867478656:192.168.206.30@tcp:104: 00000100:00100000:3.0:1787380364.064150:0:8871:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec2779e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787380364.066870:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380364.066954:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848530048 00000100:00100000:1.0:1787380364.066963:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848530048 00010000:00010000:1.0:1787380364.067000:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000072c433a9/0xcf3c46fdcad6949e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad67 expref: 10 pid: 8433 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380364.067031:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 67 00000100:00100000:1.0:1787380364.067040:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+10:2399:x1874203848530048:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380364.067054:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380364.067085:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000072c433a9/0xcf3c46fdcad6949e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad67 expref: 10 pid: 8433 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.067099:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000072c433a9/0xcf3c46fdcad6949e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad67 expref: 10 pid: 8433 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.067123:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380364.067127:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380364.067135:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000068ef8694/0xcf3c46fdcad694a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad6e expref: 10 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.067145:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068ef8694/0xcf3c46fdcad694a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad6e expref: 10 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.067179:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000068ef8694/0xcf3c46fdcad694a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad6e expref: 10 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380364.067192:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3fedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1874203867478784:192.168.206.30@tcp:105: 00000100:00100000:1.0:1787380364.067264:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5d58600 going to sleep for 11 seconds 00010000:00010000:3.0:1787380364.067922:0:8871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072c433a9/0xcf3c46fdcad6949e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad67 expref: 10 pid: 8433 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380364.067939:0:8871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3e9fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8871:1874203867478656:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380364.067960:0:8871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000068ef8694/0xcf3c46fdcad694a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad6e expref: 9 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.067978:0:8871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89c600, rc 0) 00000100:00100000:3.0:1787380364.068020:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:11332:x1874203848529920:12345-192.168.206.30@tcp:101:bash.0 Request processed in 4101us (4291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380364.068028:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 43 00000100:00100000:2.0:1787380364.072147:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380364.072247:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3fedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1874203867478784:192.168.206.30@tcp:105: 00010000:00010000:1.0:1787380364.072268:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380364.072318:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2399:x1874203848530048:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 5278us (5457us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380364.072327:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 67 00000100:00100000:3.0:1787380364.072386:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848530304 00000100:00100000:3.0:1787380364.072392:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848530304 00000100:00100000:3.0:1787380364.072436:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:3.0:1787380364.072444:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+37:11332:x1874203848530304:12345-192.168.206.30@tcp:35:bash.0 00000100:00100000:3.0:1787380364.072679:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+38:11332:x1874203848530304:12345-192.168.206.30@tcp:35:bash.0 Request processed in 225us (528us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1787380364.072686:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:2.0:1787380364.183983:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380364.184077:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848530432 00000100:00100000:0.0:1787380364.184086:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848530432 00000100:00100000:0.0:1787380364.184139:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 108 00000100:00100000:0.0:1787380364.184148:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+38:11348:x1874203848530432:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1787380364.184173:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380364.184189:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad694ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad75 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.184277:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad694b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.184289:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad694b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.184299:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad694b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380364.184341:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787380364.184345:0:10154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787380364.184359:0:10154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad694b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.184378:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad694ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad75 expref: 40 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.184393:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad694b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad75 expref: 39 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.184401:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:0.0:1787380364.184403:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787380364.184407:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866a00, rc 0) 00000100:00100000:0.0:1787380364.184446:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+39:11348:x1874203848530432:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 300us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380364.184453:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 108 00000100:00100000:2.0:1787380364.189435:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380364.189606:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848530688 00000100:00100000:1.0:1787380364.189616:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848530688 00000100:00100000:1.0:1787380364.189688:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 109 00000100:00100000:1.0:1787380364.189697:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+39:11348:x1874203848530688:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1787380364.189715:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380364.189734:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0c00/0xcf3c46fdcad694ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad7c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.190069:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad694c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.190082:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad694c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.190098:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad694c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380364.190114:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787380364.190211:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0c00/0xcf3c46fdcad694ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad7c expref: 42 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.190228:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad694c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad7c expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.190236:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6fc4767900) 00010000:00010000:1.0:1787380364.190239:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380364.190242:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df1e00, rc 0) 00000100:00100000:1.0:1787380364.190391:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+41:11348:x1874203848530688:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 694us (961us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1787380364.190398:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 109 00000100:00100000:2.0:1787380364.195931:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380364.196003:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380364.196609:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848531072 00000100:00100000:3.0:1787380364.196619:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848531072 00000100:00100000:3.0:1787380364.196677:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 110 00000100:00100000:3.0:1787380364.196686:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+41:11348:x1874203848531072:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1787380364.196707:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380364.196724:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad694cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad83 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.196845:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad694d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.196859:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad694d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.196869:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad694d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380364.196893:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787380364.196985:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad694cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad83 expref: 44 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.197002:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad694d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad83 expref: 43 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.197010:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6fc4767900) 00010000:00010000:3.0:1787380364.197012:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787380364.197015:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89d000, rc 0) 00000100:00100000:3.0:1787380364.197061:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+43:11348:x1874203848531072:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 376us (1058us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1787380364.197199:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848530816 00000100:00100000:0.0:1787380364.197204:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848530816 00000100:00100000:0.0:1787380364.197246:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:0.0:1787380364.197253:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+44:2398:x1874203848530816:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380364.197262:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380364.197273:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad694c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad7c expref: 44 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.197285:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6fc4767900) 00010000:00010000:0.0:1787380364.197288:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380364.197404:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+43:2398:x1874203848530816:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 151us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380364.197412:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:3.0:1787380364.199186:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 110 00000100:00100000:2.0:1787380364.203409:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380364.203483:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848531200 00000100:00100000:0.0:1787380364.203493:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848531200 00000100:00100000:0.0:1787380364.203543:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 44 00000100:00100000:0.0:1787380364.203552:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2399:x1874203848531200:12345-192.168.206.30@tcp:1:lfs.0 00010000:00010000:0.0:1787380364.203590:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad694e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.203609:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068ef8694/0xcf3c46fdcad694a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad6e expref: 8 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.203618:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380364.203622:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787380364.203627:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad694e4 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.203673:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068ef8694/0xcf3c46fdcad694a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad6e expref: 8 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.203687:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068ef8694/0xcf3c46fdcad694a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad6e expref: 8 pid: 8871 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380364.203701:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1874203867478912:192.168.206.30@tcp:104: 00000100:00100000:0.0:1787380364.203790:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb833240 going to sleep for 11 seconds 00000100:00100000:0.0:1787380364.213649:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d79880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1874203867478912:192.168.206.30@tcp:104: 00010000:00010000:0.0:1787380364.213677:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad694e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380364.214232:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380364.214314:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848531328 00000100:00100000:0.0:1787380364.214321:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848531328 00002000:00100000:0.0:1787380364.214363:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9d6ec3ccad80 x1874203848531328/t0(0) o4->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:170/0 lens 504/0 e 0 to 0 dl 1787380375 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380364.214373:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec3ccad80 with x1874203848531328 ext(0->8) 00010000:00010000:0.0:1787380364.214381:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000068ef8694/0xcf3c46fdcad694a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad6e expref: 9 pid: 8871 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.214397:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000068ef8694/0xcf3c46fdcad694a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad6e expref: 9 pid: 8871 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380364.214404:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d6ec3ccad80 00000100:00100000:0.0:1787380364.214490:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00100000:0.0:1787380364.214500:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:2399:x1874203848531328:12345-192.168.206.30@tcp:4:lfs.0 00000100:00100000:1.0:1787380364.217633:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+11:2399:x1874203848531328:12345-192.168.206.30@tcp:4:lfs.0 Request processed in 3126us (3394us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787380364.217685:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 1 00002000:00100000:1.0:1787380364.217697:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9d6ec3ccad80 x1874203848531328/t4294967303(0) o4->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:170/0 lens 504/448 e 0 to 0 dl 1787380375 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787380364.217708:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec3ccad80 with x1874203848531328 ext(0->8) 00010000:00010000:1.0:1787380364.217718:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000068ef8694/0xcf3c46fdcad694a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad6e expref: 11 pid: 8871 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.217736:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000068ef8694/0xcf3c46fdcad694a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad6e expref: 11 pid: 8871 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787380364.217743:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d6ec3ccad80 00000100:00100000:1.0:1787380364.221845:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380364.222967:0:10339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848531456 00000100:00100000:0.0:1787380364.222979:0:10339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848531456 00010000:00010000:0.0:1787380364.223019:0:10339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068ef8694/0xcf3c46fdcad694a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad6e expref: 11 pid: 8871 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380364.223075:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 68 00000100:00100000:0.0:1787380364.223085:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd62b7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+11:2397:x1874203848531456:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380364.223125:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787380364.223144:0:10339:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787380364.223147:0:10339:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1787380364 00002000:00010000:0.0:1787380364.223149:0:10339:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1787380364 00002000:00010000:0.0:1787380364.223152:0:10339:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1787380364 00002000:00010000:0.0:1787380364.223154:0:10339:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787380364.223161:0:10339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068ef8694/0xcf3c46fdcad694a5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad6e expref: 11 pid: 8871 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.223175:0:10339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068ef8694/0xcf3c46fdcad694a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad6e expref: 11 pid: 8871 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.223196:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068ef8694/0xcf3c46fdcad694a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad6e expref: 11 pid: 8871 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.223212:0:10339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787380364.223216:0:10339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787380364.223229:0:10339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad694e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.223246:0:10339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad694e4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.223473:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380364.223531:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd62b7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+10:2397:x1874203848531456:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 446us (1722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380364.223538:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 68 00010000:00010000:3.0:1787380364.227560:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad694e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.227954:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad694e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.227986:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad694e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.227994:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad694e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.228003:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad694e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.228024:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866200 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:3.0:1787380364.228028:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad694e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.228036:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad694e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.228361:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad694e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.228370:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad694e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380364.228517:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:2399:x1874203848531200:12345-192.168.206.30@tcp:1:lfs.0 Request processed in 24962us (25113us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380364.228528:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 44 00000100:00100000:1.0:1787380364.236131:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380364.236274:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848531712 00000100:00100000:0.0:1787380364.236283:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848531712 00000100:00100000:0.0:1787380364.236335:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 26 00000100:00100000:0.0:1787380364.236344:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7be2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+42:11348:x1874203848531712:12345-192.168.206.30@tcp:35:lfs.0 00000004:00010000:0.0:1787380364.236400:0:6525:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad694d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad83 expref: 42 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787380364.236610:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1787380364.236644:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1787380364.237008:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1787380364.237279:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad694eb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.237295:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69490 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad60 expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.237303:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad694eb lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.237345:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69490 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad60 expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.237359:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69490 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad60 expref: 46 pid: 6521 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380364.237372:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d79880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1874203867479040:192.168.206.30@tcp:104: 00000100:00100000:0.0:1787380364.237452:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb833cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380364.241550:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d79880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6525:1874203867479040:192.168.206.30@tcp:104: 00010000:00010000:0.0:1787380364.241596:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad694eb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380364.250373:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380364.250730:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848531840 00000100:00100000:0.0:1787380364.250739:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848531840 00010000:00010000:0.0:1787380364.250787:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69490 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad60 expref: 47 pid: 6521 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380364.250857:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 69 00000100:00100000:0.0:1787380364.250866:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+47:2400:x1874203848531840:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380364.250878:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380364.250884:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69490 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad60 expref: 47 pid: 6521 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.250896:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69490 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad60 expref: 47 pid: 6521 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.250947:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69490 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad60 expref: 47 pid: 6521 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.250963:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6fc4767900) 00010000:00010000:0.0:1787380364.250967:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad694eb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.250975:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad694eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.250981:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad694eb lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.251006:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380364.251235:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad694eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.251254:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad694eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787380364.251353:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1787380364.251457:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1787380364.251534:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3fef800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1874203867479168:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787380364.251591:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380364.251616:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5d58f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787380364.251633:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867479168 00000100:00100000:1.0:1787380364.251637:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867479168 00000100:00100000:1.0:1787380364.251682:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787380364.251689:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6525:x1874203867479168:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787380364.251753:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6525:x1874203867479168:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 65us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380364.251774:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787380364.251839:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3fef800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1874203867479168:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787380364.251948:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1787380364.251982:0:6525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3fef800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1874203867479296:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787380364.252021:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380364.252036:0:6525:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5d58e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787380364.252060:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867479296 00000100:00100000:1.0:1787380364.252064:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867479296 00000100:00100000:1.0:1787380364.252086:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787380364.252092:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6525:x1874203867479296:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787380364.252169:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6525:x1874203867479296:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 77us (148us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787380364.252175:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787380364.252203:0:6525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3fef800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6525:1874203867479296:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787380364.252230:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1787380364.252254:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad694eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.252263:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad694eb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.252269:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad694eb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.252285:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380364.252289:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad694eb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.252297:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad694eb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.252308:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6fc4767900) 00010000:00010000:1.0:1787380364.252311:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787380364.252315:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad694eb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.252320:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad694eb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787380364.252398:0:6525:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787380364.252448:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1787380364.252460:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 374576650047ns, next at 375576647888ns, rc = 0 00000001:00080000:1.0:1787380364.252466:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1787380364.252487:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6fc4767900) 00010000:00010000:1.0:1787380364.252489:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787380364.252496:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad694d6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad83 expref: 51 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380364.252997:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+50:2400:x1874203848531840:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 2130us (2630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380364.253006:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 69 00000100:00080000:0.0:1787380364.253032:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787380364.253297:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7be2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+49:11348:x1874203848531712:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 16953us (17173us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787380364.253306:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 26 00000020:00080000:1.0:1787380364.253310:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787380364.261260:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380364.261382:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848531968 00000100:00100000:3.0:1787380364.261392:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848531968 00000100:00100000:3.0:1787380364.261447:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 111 00000100:00100000:3.0:1787380364.261456:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+49:11348:x1874203848531968:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1787380364.261476:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380364.261495:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad694f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad8a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.261548:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad694f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad8a expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.261586:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad694f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad8a expref: 50 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.261608:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:3.0:1787380364.261612:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787380364.261615:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89dc00, rc 0) 00000100:00100000:3.0:1787380364.261675:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+50:11348:x1874203848531968:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 220us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380364.261682:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 111 00000100:00100000:2.0:1787380364.269267:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380364.270521:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848532224 00000100:00100000:1.0:1787380364.270535:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848532224 00000100:00100000:1.0:1787380364.270770:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 27 00000100:00100000:1.0:1787380364.270781:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+50:11348:x1874203848532224:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:1.0:1787380364.271189:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+51:11348:x1874203848532224:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 266us (1804us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1787380364.271201:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 27 00000100:00100000:2.0:1787380364.348415:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380364.350877:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848532352 00000100:00100000:3.0:1787380364.350891:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848532352 00000100:00100000:3.0:1787380364.350962:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 112 00000100:00100000:3.0:1787380364.350972:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+51:11358:x1874203848532352:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:3.0:1787380364.351041:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad694f9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.351057:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad694f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.351067:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad694f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.351076:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69500 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.351082:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69500 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.351104:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69500 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.351172:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69507 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.351180:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69507 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.351187:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69507 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787380364.351225:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69507 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.352958:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad694f9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.352975:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad694f9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.352982:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad694f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.352988:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380364.352992:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad694f9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.353000:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad694f9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.353014:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:3.0:1787380364.353030:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380364.353035:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad694f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.353042:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad694f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.353060:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69500 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.353066:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69500 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.353072:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69500 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.353077:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89de00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380364.353081:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69500 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.353086:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69500 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.353094:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec241be00) 00010000:00010000:3.0:1787380364.353097:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380364.353099:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69500 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.353104:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69500 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.353113:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69507 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.353124:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69507 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.353129:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69507 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.353133:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89ca00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380364.353136:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69507 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.353141:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69507 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.353148:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:3.0:1787380364.353150:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380364.353153:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69507 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.353158:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69507 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380364.353248:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+51:11358:x1874203848532352:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 2267us (4833us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380364.353257:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 112 00010000:00010000:1.0:1787380364.364056:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380364.407704:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380364.408069:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848532608 00000100:00100000:3.0:1787380364.408078:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848532608 00000100:00100000:3.0:1787380364.408138:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 113 00000100:00100000:3.0:1787380364.408148:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+51:11361:x1874203848532608:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1787380364.408168:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380364.408201:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad6950e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad91 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408271:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69515 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408287:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69515 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408298:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69515 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408310:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad6951c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408317:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad6951c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408324:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad6951c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408428:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89da00/0xcf3c46fdcad69523 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408437:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89da00/0xcf3c46fdcad69523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408445:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89da00/0xcf3c46fdcad69523 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380364.408455:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787380364.408534:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69515 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408552:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69515 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408558:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69515 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408563:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89de00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380364.408567:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69515 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408574:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69515 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408586:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:3.0:1787380364.408588:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380364.408593:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69515 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408598:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69515 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408612:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad6951c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408618:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad6951c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408623:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad6951c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408644:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380364.408655:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad6951c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408661:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad6951c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408669:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec241be00) 00010000:00010000:3.0:1787380364.408672:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380364.408674:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad6951c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408680:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad6951c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408714:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad6950e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad91 expref: 54 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408728:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89da00/0xcf3c46fdcad69523 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad91 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.408736:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:3.0:1787380364.408738:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380364.408740:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89da00, rc 0) 00000100:00100000:2.0:1787380364.411026:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4f23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+53:11361:x1874203848532608:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 2872us (3328us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787380364.411039:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 113 00000100:00100000:2.0:1787380364.415866:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380364.415914:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848532736 00000100:00100000:3.0:1787380364.415924:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848532736 00000100:00100000:3.0:1787380364.415988:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 114 00000100:00100000:3.0:1787380364.415998:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+53:11361:x1874203848532736:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:3.0:1787380364.416062:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69531 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.416092:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69531 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.416103:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69531 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.416136:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69531 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.416143:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69531 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.416150:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69531 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.416156:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380364.416160:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69531 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.416168:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69531 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.416179:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:3.0:1787380364.416182:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380364.416186:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69531 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.416192:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69531 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380364.416263:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+53:11361:x1874203848532736:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 265us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380364.416277:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 114 00000100:00100000:1.0:1787380364.422091:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380364.424027:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848532992 00000100:00100000:2.0:1787380364.424040:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848532992 00000100:00100000:2.0:1787380364.424102:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 28 00000100:00100000:2.0:1787380364.424112:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+53:11361:x1874203848532992:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1787380364.424322:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+54:11361:x1874203848532992:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 211us (2239us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1787380364.424331:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 28 00000100:00100000:1.0:1787380364.558893:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380364.559001:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848533248 00000100:00100000:0.0:1787380364.559010:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848533248 00000100:00100000:0.0:1787380364.559072:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 115 00000100:00100000:0.0:1787380364.559082:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+54:11371:x1874203848533248:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1787380364.559106:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380364.559109:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787380364.559136:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad694b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad75 expref: 54 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.559155:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:0.0:1787380364.559174:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380364.559186:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69538 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad98 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.559290:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6953f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.559312:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6953f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.559321:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6953f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380364.559330:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787380364.559417:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69538 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad98 expref: 56 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.559431:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6953f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad98 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.559437:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:0.0:1787380364.559440:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380364.559442:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867a00, rc 0) 00000100:00100000:0.0:1787380364.559506:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+55:11371:x1874203848533248:12345-192.168.206.30@tcp:101:bash.0 Request processed in 426us (621us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787380364.559513:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 115 00000100:00100000:3.0:1787380364.563222:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380364.563272:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380364.563369:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848533504 00000100:00100000:1.0:1787380364.563378:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848533504 00000100:00100000:1.0:1787380364.563437:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:1.0:1787380364.563447:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+55:2398:x1874203848533504:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380364.563471:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380364.563493:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6953f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad98 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.563511:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:1.0:1787380364.563516:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380364.563562:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+54:2398:x1874203848533504:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 116us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380364.563570:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:2.0:1787380364.564020:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848533376 00000100:00100000:2.0:1787380364.564024:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848533376 00000100:00100000:2.0:1787380364.564059:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 116 00000100:00100000:2.0:1787380364.564067:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+54:11371:x1874203848533376:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:2.0:1787380364.564084:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380364.564098:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ec00/0xcf3c46fdcad6954d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ad9f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.564148:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69554 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.564160:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69554 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.564170:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69554 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.564278:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ec00/0xcf3c46fdcad6954d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad9f expref: 56 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.564302:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69554 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad9f expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.564311:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:2.0:1787380364.564314:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787380364.564316:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0fe00, rc 0) 00000100:00100000:2.0:1787380364.564350:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+55:11371:x1874203848533376:12345-192.168.206.30@tcp:101:bash.0 Request processed in 284us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380364.564356:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 116 00000100:00100000:3.0:1787380364.568867:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380364.568984:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848533760 00000100:00100000:0.0:1787380364.568994:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848533760 00000100:00100000:0.0:1787380364.569047:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 117 00000100:00100000:0.0:1787380364.569055:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+55:11371:x1874203848533760:12345-192.168.206.30@tcp:36:bash.0 00010000:00010000:0.0:1787380364.569113:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380364.569138:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89da00/0xcf3c46fdcad69523 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad91 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.569154:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:0.0:1787380364.569158:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380364.569326:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6955b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.569339:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6955b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.569348:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6955b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787380364.569386:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1787380364.569406:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000130b45a2 reply state 00000000b6eb74b3 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6955b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.569418:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6955b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.569424:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:0.0:1787380364.569426:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787380364.569429:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787380364.569503:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+57:11371:x1874203848533760:12345-192.168.206.30@tcp:36:bash.0 Request processed in 447us (643us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787380364.569510:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 117 00000020:00080000:0.0:1787380364.569515:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787380364.578715:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380364.578799:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848533888 00000100:00100000:1.0:1787380364.578842:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848533888 00000100:00100000:1.0:1787380364.578887:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 118 00000100:00100000:1.0:1787380364.578896:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec335b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+57:11371:x1874203848533888:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:1.0:1787380364.578940:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380364.578960:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0000/0xcf3c46fdcad69562 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ada6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.579041:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad69569 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.579056:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad69569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.579066:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad69569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380364.579094:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787380364.579098:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787380364.579116:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad69569 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.579142:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0000/0xcf3c46fdcad69562 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ada6 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.579158:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad69569 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ada6 expref: 58 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380364.579167:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:1.0:1787380364.579170:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380364.579173:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df0e00, rc 0) 00000100:00100000:1.0:1787380364.579228:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec335b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+58:11371:x1874203848533888:12345-192.168.206.30@tcp:101:bash.0 Request processed in 333us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380364.579244:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 118 00000100:00100000:1.0:1787380364.583026:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380364.583134:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848534144 00000100:00100000:3.0:1787380364.583144:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848534144 00000100:00100000:3.0:1787380364.583197:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 29 00000100:00100000:3.0:1787380364.583206:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+58:11371:x1874203848534144:12345-192.168.206.30@tcp:35:bash.0 00000100:00100000:3.0:1787380364.583425:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:11371:x1874203848534144:12345-192.168.206.30@tcp:35:bash.0 Request processed in 219us (407us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1787380364.583432:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 29 00000100:00100000:3.0:1787380364.702260:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380364.702360:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848534272 00000100:00100000:0.0:1787380364.702380:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848534272 00000100:00100000:0.0:1787380364.702436:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 119 00000100:00100000:0.0:1787380364.702446:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:11377:x1874203848534272:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1787380364.702478:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380364.702496:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69570 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0adad expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.702554:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69577 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.702566:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69577 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.702579:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69577 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380364.702622:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1787380364.702626:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787380364.702644:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69577 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.702678:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69570 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adad expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.702696:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69577 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adad expref: 60 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.702713:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:0.0:1787380364.702716:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787380364.702719:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866a00, rc 0) 00000100:00100000:0.0:1787380364.702889:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:11377:x1874203848534272:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 444us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380364.702897:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 119 00000100:00100000:1.0:1787380364.721996:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380364.722192:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848534400 00000100:00100000:2.0:1787380364.722202:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848534400 00000100:00100000:2.0:1787380364.722260:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 120 00000100:00100000:2.0:1787380364.722269:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:11377:x1874203848534400:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1787380364.722287:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380364.722316:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ec00/0xcf3c46fdcad6957e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0adb4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722372:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad69585 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722384:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad69585 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722395:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad69585 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722406:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad6958c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722413:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad6958c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722420:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad6958c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722481:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69593 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722489:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69593 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722495:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69593 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380364.722533:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787380364.722537:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787380364.722554:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69593 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722585:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69593 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722594:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad69585 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722600:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad69585 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722605:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad69585 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722610:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0fc00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380364.722614:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad69585 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722621:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad69585 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722633:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:2.0:1787380364.722636:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380364.722639:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad69585 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722644:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad69585 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722656:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad6958c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722662:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad6958c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722673:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad6958c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722677:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0fa00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380364.722680:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad6958c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722686:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad6958c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722694:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec241be00) 00010000:00010000:2.0:1787380364.722696:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380364.722699:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad6958c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722705:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad6958c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722730:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ec00/0xcf3c46fdcad6957e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adb4 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722742:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69593 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adb4 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.722749:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:2.0:1787380364.722751:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380364.722753:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0f200, rc 0) 00000100:00100000:2.0:1787380364.722829:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+61:11377:x1874203848534400:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 539us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380364.722846:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 120 00000100:00100000:1.0:1787380364.732270:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380364.732343:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380364.732412:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848534784 00000100:00100000:2.0:1787380364.732422:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848534784 00000100:00100000:2.0:1787380364.732482:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:2.0:1787380364.732491:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+61:2400:x1874203848534784:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380364.732505:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380364.732526:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69593 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adb4 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.732543:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:2.0:1787380364.732547:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380364.732613:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:2400:x1874203848534784:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 123us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380364.732620:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:0.0:1787380364.733848:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848534656 00000100:00100000:0.0:1787380364.733857:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848534656 00000100:00100000:0.0:1787380364.733896:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 121 00000100:00100000:0.0:1787380364.733915:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:11377:x1874203848534656:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1787380364.733932:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380364.733948:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad6959a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0adbb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.734063:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad695a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.734077:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad69569 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ada6 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.734085:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad695a1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.734116:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad69569 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ada6 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.734129:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad69569 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ada6 expref: 61 pid: 6522 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380364.734141:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d79880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867479424:192.168.206.30@tcp:104: 00000100:00100000:0.0:1787380364.734213:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb833600 going to sleep for 11 seconds 00000100:00100000:1.0:1787380364.740107:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380364.740742:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848534912 00000100:00100000:3.0:1787380364.740751:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848534912 00010000:00010000:3.0:1787380364.740795:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad69569 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ada6 expref: 62 pid: 6522 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380364.740866:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 70 00000100:00100000:3.0:1787380364.740876:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+62:2399:x1874203848534912:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380364.740889:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380364.740895:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad69569 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ada6 expref: 62 pid: 6522 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.740918:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad69569 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ada6 expref: 62 pid: 6522 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.740955:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:3.0:1787380364.740960:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad695a1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.740970:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad695a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.740976:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad695a1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380364.740994:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380364.741341:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+62:2399:x1874203848534912:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 465us (1241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380364.741349:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 70 00010000:00010000:0.0:1787380364.741516:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad69569 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ada6 expref: 61 pid: 6522 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380364.741532:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d79880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867479424:192.168.206.30@tcp:104: 00010000:00010000:0.0:1787380364.741551:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad695a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.741560:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad695a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.741566:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad695a1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380364.741583:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787380364.741715:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad6959a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adbb expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.741730:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad695a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adbb expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.741738:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:0.0:1787380364.741741:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787380364.741743:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866800, rc 0) 00000100:00100000:0.0:1787380364.741780:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3feed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+61:11377:x1874203848534656:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 7877us (9517us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787380364.741787:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 121 00000100:00100000:2.0:1787380364.752132:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380364.752383:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848535168 00000100:00100000:0.0:1787380364.752392:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848535168 00000100:00100000:0.0:1787380364.752486:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:0.0:1787380364.752518:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3359500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+61:11377:x1874203848535168:12345-192.168.206.30@tcp:103:lfs.0 00010000:00010000:0.0:1787380364.752533:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380364.752556:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad694f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad8a expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.752584:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:0.0:1787380364.752589:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380364.752638:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3359500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:11377:x1874203848535168:12345-192.168.206.30@tcp:103:lfs.0 Request processed in 133us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380364.752646:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:2.0:1787380364.756126:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380364.756214:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848535296 00000100:00100000:0.0:1787380364.756223:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848535296 00000100:00100000:0.0:1787380364.756414:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 122 00000100:00100000:0.0:1787380364.756423:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:11377:x1874203848535296:12345-192.168.206.30@tcp:58:lfs.0 00010000:00010000:0.0:1787380364.756667:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad695af lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.756683:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad695af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380364.756693:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad695af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787380364.757002:0:10154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1787380364.757121:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:11377:x1874203848535296:12345-192.168.206.30@tcp:58:lfs.0 Request processed in 698us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380364.757129:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 122 00000100:00100000:3.0:1787380364.759443:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380364.759577:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848535424 00000100:00100000:2.0:1787380364.759585:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848535424 00000100:00100000:2.0:1787380364.759635:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 123 00000100:00100000:2.0:1787380364.759644:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:11377:x1874203848535424:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1787380364.759672:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380364.759689:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ec00/0xcf3c46fdcad695b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0adc2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.759746:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad695af lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.759910:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ec00/0xcf3c46fdcad695b6 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adc2 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.759930:0:6521:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad695af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.759943:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ec00/0xcf3c46fdcad695b6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adc2 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.759956:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:2.0:1787380364.759959:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787380364.759963:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ec00/0xcf3c46fdcad695b6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adc2 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380364.759970:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0ec00, rc 0) 00000100:00100000:2.0:1787380364.760017:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+61:11377:x1874203848535424:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 374us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380364.760024:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 123 00000040:00080000:2.0:1787380365.004083:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787380365.004093:0:13800:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787380365.004119:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787380365.004128:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787380365.004284:0:13800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d9f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1874203867479552:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787380365.005621:0:13800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc9566c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380365.029630:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380365.029801:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848535552 00000100:00100000:0.0:1787380365.029986:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848535552 00000100:00100000:2.0:1787380365.030040:0:13800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d9f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1874203867479552:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787380365.030066:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 124 00000100:00100000:0.0:1787380365.030079:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+61:11378:x1874203848535552:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787380365.030750:0:6522:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787380365.030894:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+61:11378:x1874203848535552:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 817us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380365.030915:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 124 00000100:00100000:0.0:1787380365.047233:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380365.047322:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848535680 00000100:00100000:3.0:1787380365.047331:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848535680 00000100:00100000:3.0:1787380365.047384:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 125 00000100:00100000:3.0:1787380365.047397:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+61:11378:x1874203848535680:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787380365.047459:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad695bd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.047475:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad695bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.047486:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad695bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.047517:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad695c4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.047524:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad695c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.047531:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad695c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.047550:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.047558:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.047565:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380365.047605:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787380365.047608:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787380365.047618:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048264:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad695bd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048275:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad695bd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048283:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad695bd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048457:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89ca00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380365.048462:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad695bd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048470:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad695bd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048483:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6ec25a8300) 00010000:00010000:3.0:1787380365.048486:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380365.048490:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad695bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048497:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad695bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048511:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad695c4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048517:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad695c4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048523:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad695c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048528:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380365.048531:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad695c4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048537:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad695c4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048553:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9d6ec241b700) 00010000:00010000:3.0:1787380365.048555:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380365.048558:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad695c4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048564:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad695c4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048585:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048591:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048597:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048602:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380365.048605:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048610:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048616:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:3.0:1787380365.048618:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380365.048621:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.048626:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380365.049057:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+61:11378:x1874203848535680:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 Request processed in 1661us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380365.049074:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 125 00000100:00100000:2.0:1787380365.051652:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380365.051931:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848535936 00000100:00100000:0.0:1787380365.051941:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848535936 00000100:00100000:0.0:1787380365.052036:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 126 00000100:00100000:0.0:1787380365.052045:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+61:11378:x1874203848535936:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380365.052063:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380365.052080:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad695d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0adc9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.052167:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad695d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.052181:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad695d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.052191:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad695d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380365.052201:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787380365.052262:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad695d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.052284:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad695d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.052291:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad695d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.052297:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380365.052301:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad695d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.052308:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad695d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.052319:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:0.0:1787380365.052321:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787380365.052325:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad695d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.052331:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad695d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.052364:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad695d2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adc9 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.052374:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6ec25a8300) 00010000:00010000:0.0:1787380365.052376:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787380365.052381:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad695d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adc9 expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.052389:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867400, rc 0) 00000100:00100000:0.0:1787380365.053225:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+62:11378:x1874203848535936:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 1177us (1577us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1787380365.053236:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 126 00000100:00100000:0.0:1787380365.083768:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380365.083886:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848536064 00000100:00100000:3.0:1787380365.083908:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848536064 00000100:00100000:3.0:1787380365.083984:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 127 00000100:00100000:3.0:1787380365.083995:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+62:11378:x1874203848536064:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787380365.084027:0:10154:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787380365.084137:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+62:11378:x1874203848536064:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 144us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380365.084144:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 127 00000100:00100000:2.0:1787380365.104695:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380365.104787:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848536320 00000100:00100000:0.0:1787380365.104796:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848536320 00000100:00100000:0.0:1787380365.104865:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 128 00000100:00100000:0.0:1787380365.104874:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+62:11378:x1874203848536320:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380365.104891:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380365.104894:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787380365.104925:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69577 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adad expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.104943:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:0.0:1787380365.104947:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380365.104967:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad695e7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0add0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787380365.105503:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:0.0:1787380365.105621:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad695ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.105633:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad695ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.105644:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad695ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.105686:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad695e7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0add0 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.105712:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad695ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0add0 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.105720:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d6ec26f4100) 00010000:00010000:0.0:1787380365.105723:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380365.105726:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867400, rc 0) 00000100:00100000:0.0:1787380365.106021:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+63:11378:x1874203848536320:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 1146us (1332us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787380365.106030:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 128 00000100:00100000:0.0:1787380365.110319:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380365.111291:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848536576 00000100:00100000:3.0:1787380365.111309:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848536576 00000100:00100000:3.0:1787380365.111392:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 129 00000100:00100000:3.0:1787380365.111403:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+63:11378:x1874203848536576:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787380365.111473:0:10154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380365.111502:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad695ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0add0 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.111521:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d6ec26f4100) 00010000:00010000:3.0:1787380365.111533:0:10154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380365.111557:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695fc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.111572:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.111584:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.111687:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69603 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x97cea86f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.111696:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69603 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x97cea86f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.111703:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69603 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x97cea86f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.112537:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695fc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.112549:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695fc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.112556:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.112563:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380365.112568:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695fc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.112576:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695fc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.112589:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:3.0:1787380365.112592:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380365.112596:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695fc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.112602:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad695fc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.112646:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69603 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x97cea86f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.112660:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69603 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x97cea86f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.112666:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69603 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x97cea86f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.112670:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380365.112673:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69603 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x97cea86f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.112679:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69603 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x97cea86f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.112688:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x97cea86f (ffff9d6ec241b700) 00010000:00010000:3.0:1787380365.112690:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380365.112693:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69603 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x97cea86f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.112698:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69603 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x97cea86f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380365.113192:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+62:11378:x1874203848536576:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 1784us (2878us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787380365.113203:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 129 00000100:00100000:0.0:1787380365.117047:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380365.117471:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848536704 00000100:00100000:3.0:1787380365.117482:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848536704 00000100:00100000:3.0:1787380365.117552:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 130 00000100:00100000:3.0:1787380365.117579:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+62:11378:x1874203848536704:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380365.117602:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380365.117626:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad6960a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0add7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.117681:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69611 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.117696:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69611 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.117708:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69611 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.120131:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad6960a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0add7 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.120163:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69611 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0add7 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.120173:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d6ec241b300) 00010000:00010000:1.0:1787380365.120176:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787380365.120180:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89de00, rc 0) 00000100:00100000:1.0:1787380365.120609:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+63:11378:x1874203848536704:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 3028us (3570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380365.120619:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 130 00000100:00100000:0.0:1787380365.125316:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380365.125553:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848536960 00000100:00100000:3.0:1787380365.125566:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848536960 00000100:00100000:3.0:1787380365.125644:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 131 00000100:00100000:3.0:1787380365.125665:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+63:11378:x1874203848536960:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787380365.125769:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69618 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.125786:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69618 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.125798:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69618 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787380365.126028:0:10154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1787380365.126038:0:10154:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375450228351ns, next at 376450225591ns, rc = 0 00000004:00010000:3.0:1787380365.126088:0:10154:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d88796a9 reply state 000000009d12cf94 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69618 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.126118:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69618 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.126124:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d6ec241b300) 00010000:00010000:3.0:1787380365.126127:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787380365.126131:0:10154:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380365.126226:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+65:11378:x1874203848536960:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 564us (920us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787380365.126233:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 131 00000100:00100000:0.0:1787380365.130598:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380365.132490:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848537088 00000100:00100000:2.0:1787380365.132586:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848537088 00000100:00100000:2.0:1787380365.133443:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 132 00000100:00100000:2.0:1787380365.133458:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+65:11378:x1874203848537088:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380365.133483:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380365.133502:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6961f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0adde expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.133830:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6961f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adde expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.133854:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6961f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adde expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.133875:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d6ec241b300) 00010000:00010000:2.0:1787380365.133878:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787380365.133881:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0e600, rc 0) 00000100:00100000:2.0:1787380365.133986:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+66:11378:x1874203848537088:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 532us (3406us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380365.133995:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 132 00000100:00100000:0.0:1787380365.136780:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380365.137492:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848537216 00000100:00100000:1.0:1787380365.137502:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848537216 00000100:00100000:1.0:1787380365.137579:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 45 00000100:00100000:1.0:1787380365.137589:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2400:x1874203848537216:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787380365.137833:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:2400:x1874203848537216:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 245us (1061us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787380365.137841:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 45 00000100:00080000:0.0:1787380365.137978:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380365.143070:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380365.143140:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848537472 00000100:00100000:1.0:1787380365.143148:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848537472 00000100:00100000:1.0:1787380365.143196:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 30 00000100:00100000:1.0:1787380365.143216:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+66:11378:x1874203848537472:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787380365.143394:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+67:11378:x1874203848537472:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 179us (331us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1787380365.143401:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 30 00000100:00100000:3.0:1787380365.146294:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380365.146357:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848537728 00000100:00100000:0.0:1787380365.146366:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848537728 00000100:00100000:0.0:1787380365.146410:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 133 00000100:00100000:0.0:1787380365.146418:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+67:11378:x1874203848537728:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787380365.146515:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+67:11378:x1874203848537728:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 97us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380365.146521:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 133 00000100:00100000:0.0:1787380365.151476:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380365.151611:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848537856 00000100:00100000:1.0:1787380365.151620:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848537856 00000100:00100000:1.0:1787380365.151747:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 134 00000100:00100000:1.0:1787380365.151756:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+67:11378:x1874203848537856:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787380365.152064:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380365.152085:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0400/0xcf3c46fdcad69626 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ade5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.152146:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6962d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.152159:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6962d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.152171:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6962d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380365.152212:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787380365.152346:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6962d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.152374:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0400/0xcf3c46fdcad69626 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ade5 expref: 69 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.152391:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6962d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ade5 expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.152412:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d6ec241b300) 00010000:00010000:1.0:1787380365.152415:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787380365.152418:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df0a00, rc 0) 00000100:00100000:1.0:1787380365.152477:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+68:11378:x1874203848537856:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 722us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380365.152484:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 134 00000100:00100000:2.0:1787380365.178090:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380365.182444:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848537984 00000100:00100000:3.0:1787380365.182459:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848537984 00000100:00100000:2.0:1787380365.186254:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 46 00000100:00100000:2.0:1787380365.186267:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:2399:x1874203848537984:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380365.186298:0:8871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380365.186317:0:8871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69634 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0adec expref: -99 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787380365.186340:0:8871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a89428d, blocks: 0x0 00010000:00010000:2.0:1787380365.186357:0:8871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=375s v=(0 0) 00010000:00010000:2.0:1787380365.186361:0:8871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380365.186370:0:8871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69634 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adec expref: 10 pid: 8871 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.186387:0:8871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69634 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adec expref: 10 pid: 8871 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.186400:0:8871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0e400, rc 0) 00000100:00100000:2.0:1787380365.186463:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+10:2399:x1874203848537984:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 198us (8381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380365.186471:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 46 00000100:00100000:1.0:1787380365.199408:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380365.199488:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848538240 00000100:00100000:2.0:1787380365.199496:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848538240 00000100:00100000:2.0:1787380365.199549:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 135 00000100:00100000:2.0:1787380365.199560:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+68:11378:x1874203848538240:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787380365.199655:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3feca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+68:11378:x1874203848538240:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 98us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380365.199663:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 135 00000100:00100000:0.0:1787380365.203103:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380365.203212:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848538368 00000100:00100000:3.0:1787380365.203221:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848538368 00000100:00100000:3.0:1787380365.203443:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 47 00000100:00100000:3.0:1787380365.203452:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+10:11378:x1874203848538368:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380365.203467:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380365.203483:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d8e012e/0xcf3c46fdcad6963b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0adf3 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.203786:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69634 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adec expref: 11 pid: 8871 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.203797:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380365.203801:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380365.203883:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d8e012e/0xcf3c46fdcad6963b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adf3 expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.204008:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69634 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adec expref: 11 pid: 8871 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.204023:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69634 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adec expref: 11 pid: 8871 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380365.204037:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1874203867479680:192.168.206.30@tcp:104: 00000100:00100000:0.0:1787380365.204216:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb833540 going to sleep for 11 seconds 00000100:00100000:0.0:1787380365.208541:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380365.208736:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d7bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1874203867479680:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380365.208779:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006d8e012e/0xcf3c46fdcad6963b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adf3 expref: 11 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.208799:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89d200, rc 0) 00000100:00100000:2.0:1787380365.208878:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+11:11378:x1874203848538368:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 5427us (5785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380365.208887:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 47 00000100:00100000:1.0:1787380365.209540:0:10339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848538496 00000100:00100000:1.0:1787380365.209549:0:10339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848538496 00010000:00010000:1.0:1787380365.209582:0:10339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69634 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adec expref: 11 pid: 8871 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380365.209612:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 71 00000100:00100000:1.0:1787380365.209620:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+11:2400:x1874203848538496:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380365.209632:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380365.209659:0:10339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69634 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adec expref: 11 pid: 8871 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.209673:0:10339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69634 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adec expref: 11 pid: 8871 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.209696:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69634 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adec expref: 11 pid: 8871 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.209723:0:10339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380365.209728:0:10339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380365.209736:0:10339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d8e012e/0xcf3c46fdcad6963b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adf3 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.209746:0:10339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d8e012e/0xcf3c46fdcad6963b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adf3 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.209778:0:10339:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006d8e012e/0xcf3c46fdcad6963b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adf3 expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380365.209792:0:10339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3fee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10339:1874203867479808:192.168.206.30@tcp:105: 00000100:00100000:1.0:1787380365.210090:0:10339:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5d58e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787380365.219972:0:10339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3fee300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10339:1874203867479808:192.168.206.30@tcp:105: 00010000:00010000:1.0:1787380365.219998:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380365.220054:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+10:2400:x1874203848538496:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 10433us (11520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380365.220065:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 71 00000100:00100000:0.0:1787380365.221226:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380365.221404:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848538624 00000100:00100000:2.0:1787380365.221412:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848538624 00002000:00100000:2.0:1787380365.221452:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9d6ec3d04380 x1874203848538624/t0(0) o4->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:171/0 lens 504/0 e 0 to 0 dl 1787380376 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787380365.221463:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec3d04380 with x1874203848538624 ext(0->12) 00002000:00010000:2.0:1787380365.221467:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d6ec3d04380 00000100:00100000:2.0:1787380365.221508:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:2.0:1787380365.221517:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+10:2399:x1874203848538624:12345-192.168.206.30@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787380365.225522:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+12:2399:x1874203848538624:12345-192.168.206.30@tcp:4:lhsmtool_posix.0 Request processed in 3998us (4290us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787380365.225538:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 2 00002000:00100000:0.0:1787380365.225549:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9d6ec3d04380 x1874203848538624/t4294967309(0) o4->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:171/0 lens 504/448 e 0 to 0 dl 1787380376 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380365.225558:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec3d04380 with x1874203848538624 ext(0->12) 00002000:00010000:0.0:1787380365.225563:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d6ec3d04380 00000100:00100000:0.0:1787380365.230089:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380365.230174:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848538752 00000100:00100000:2.0:1787380365.230184:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848538752 00000100:00100000:2.0:1787380365.230234:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 136 00000100:00100000:2.0:1787380365.230244:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+68:11378:x1874203848538752:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787380365.239951:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1787380365.239970:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00010000:00010000:0.0:1787380365.239994:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69340 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.240006:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69340 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.240013:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69340 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787380365.240022:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:0.0:1787380365.240038:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867c00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380365.240043:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69340 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787380365.240047:0:6500:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d6fc3d22f00 refcount 2 committed 0 result 0 batchid 3 00010000:00010000:0.0:1787380365.240051:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69340 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787380365.240053:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6fff508700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d6fc3d22cc0 00000020:00080000:3.0:1787380365.240061:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6fff508500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d6ec3dba000 00010000:00010000:0.0:1787380365.240073:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9d6ec25aa700) 00010000:00010000:0.0:1787380365.240078:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380365.240083:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69340 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787380365.240084:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:0.0:1787380365.240092:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69340 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787380365.240116:0:6500:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d6fc3ebcc00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1787380365.240120:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ffc93ba00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d6fc3ebc480 00000020:00080000:3.0:1787380365.240123:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ffc93bc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d6ec2047800 00010000:00010000:0.0:1787380365.240125:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad693e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.240136:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad693e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787380365.240142:0:6500:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:0.0:1787380365.240144:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad693e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.240151:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdaa00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380365.240155:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad693e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.240161:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad693e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.240180:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9d6ec3030100) 00010000:00010000:0.0:1787380365.240183:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380365.240186:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad693e8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.240192:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdaa00/0xcf3c46fdcad693e8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.240209:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69466 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.240215:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69466 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.240220:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69466 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.240225:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fda000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380365.240228:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69466 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.240233:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69466 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.240240:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec241be00) 00010000:00010000:0.0:1787380365.240242:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380365.240245:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69466 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.240251:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda000/0xcf3c46fdcad69466 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.240270:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad69489 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.240275:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad69489 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.240280:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad69489 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.240284:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0f400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380365.240287:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad69489 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787380365.240467:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1787380365.240529:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787380365.240593:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3fee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867479936:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787380365.240660:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380365.240953:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867479936 00000100:00100000:1.0:1787380365.240960:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867479936 00000100:00100000:1.0:1787380365.241007:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787380365.241016:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3641:x1874203867479936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787380365.241047:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:1.0:1787380365.241075:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a89428c, atime: 0x6a89428c, ctime: 0x6a89428c, blocks: 0x8 00010000:00010000:1.0:1787380365.241082:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000817c096/0xcf3c46fdcad69642 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.241094:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=375s v=(0 0) 00010000:00010000:1.0:1787380365.241099:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380365.241104:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000817c096/0xcf3c46fdcad69642 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.241116:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000817c096/0xcf3c46fdcad69642 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.241124:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000817c096/0xcf3c46fdcad69642 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.241132:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000817c096/0xcf3c46fdcad69642 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.241145:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787380365.241255:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3641:x1874203867479936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 240us (594us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787380365.241262:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787380365.241836:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867480064:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1787380365.241961:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6ec3fee300/2, rc 0, transno 4294967305 00000100:00100000:1.0:1787380365.241966:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3fee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867479936:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787380365.242168:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad69489 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.242182:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec241be00) 00010000:00010000:0.0:1787380365.242185:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380365.242189:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad69489 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.242195:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad69489 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.242225:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6955b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.242232:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6955b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.242237:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6955b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.242251:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380365.242255:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6955b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.242261:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6955b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.242270:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:0.0:1787380365.242272:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380365.242275:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6955b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.242280:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6955b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.242303:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69618 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.242310:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69618 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.242315:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69618 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.242321:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380365.242324:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69618 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.242329:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69618 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.242347:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d6ec241b300) 00010000:00010000:0.0:1787380365.242349:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787380365.242352:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69618 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.242357:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69618 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.242961:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380365.242967:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000817c096/0xcf3c46fdcad69642 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.242977:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df0600 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380365.242980:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000817c096/0xcf3c46fdcad69642 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.242989:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000817c096/0xcf3c46fdcad69642 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.243003:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000817c096/0xcf3c46fdcad69642 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.243010:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000817c096/0xcf3c46fdcad69642 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.243027:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380365.243029:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380365.243037:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380365.243139:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+16:11378:x1874203848538752:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 Request processed in 12893us (13054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380365.243148:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 136 00000100:00100000:3.0:1787380365.246480:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380365.246663:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380365.247027:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867480192:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787380365.247066:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380365.247145:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848538880 00000100:00100000:0.0:1787380365.247153:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848538880 00000100:00100000:0.0:1787380365.247200:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867480064 00000100:00100000:0.0:1787380365.247203:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867480064 00000100:00100000:0.0:1787380365.247233:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 49 00000100:00100000:0.0:1787380365.247241:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+12:2400:x1874203848538880:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 00000100:00080000:0.0:1787380365.247470:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380365.247632:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787380365.247641:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1874203867480064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787380365.247666:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:3.0:1787380365.247685:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd8bf8bc/0xcf3c46fdcad69649 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.247704:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad693f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad4b expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.247712:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787380365.247721:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787380365.247727:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd8bf8bc/0xcf3c46fdcad69649 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.247767:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad693f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad4b expref: 12 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.247781:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad693f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad4b expref: 12 pid: 8436 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380365.247793:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f25500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1874203867480320:192.168.206.30@tcp:104: 00000100:00100000:3.0:1787380365.247878:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec27799c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380365.251149:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f25500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8435:1874203867480320:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380365.251175:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000dd8bf8bc/0xcf3c46fdcad69649 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787380365.253176:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1787380365.253195:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:2.0:1787380365.253387:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867480192 00000100:00100000:2.0:1787380365.253405:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867480192 00000100:00100000:2.0:1787380365.253448:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787380365.253469:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3639:x1874203867480192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787380365.254932:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00002000:00010000:2.0:1787380365.255977:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787380365.255983:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787380365 00002000:00010000:2.0:1787380365.255986:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787380365.255989:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787380365 -> 1787380365 00002000:00010000:2.0:1787380365.255991:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787380365.256054:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3639:x1874203867480192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2586us (8986us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787380365.256064:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787380365.256121:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848539008 00000100:00100000:2.0:1787380365.256128:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848539008 00010000:00010000:2.0:1787380365.256155:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad693f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad4b expref: 8 pid: 8436 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380365.256183:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 72 00000100:00100000:2.0:1787380365.256191:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd62b4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2400:x1874203848539008:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380365.256203:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380365.256209:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad693f6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad4b expref: 8 pid: 8436 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.256222:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad693f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad4b expref: 8 pid: 8436 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.256242:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad693f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad4b expref: 8 pid: 8436 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.256271:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787380365.256276:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787380365.256281:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd8bf8bc/0xcf3c46fdcad69649 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.256353:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd8bf8bc/0xcf3c46fdcad69649 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.256447:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380365.256539:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd62b4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2400:x1874203848539008:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 348us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380365.256547:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 72 00010000:00010000:2.0:1787380365.256593:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000dd8bf8bc/0xcf3c46fdcad69649 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.256603:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd8bf8bc/0xcf3c46fdcad69649 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.256612:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd8bf8bc/0xcf3c46fdcad69649 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.256619:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd8bf8bc/0xcf3c46fdcad69649 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.256634:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787380365.257057:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3642:x1874203867480064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9417us (10393us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787380365.257064:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1787380365.257084:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380365.257089:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd8bf8bc/0xcf3c46fdcad69649 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.257097:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c200 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380365.257101:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd8bf8bc/0xcf3c46fdcad69649 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.257109:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd8bf8bc/0xcf3c46fdcad69649 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.257122:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd8bf8bc/0xcf3c46fdcad69649 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.257130:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd8bf8bc/0xcf3c46fdcad69649 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.257144:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380365.257146:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380365.257147:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380365.258179:0:3639:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1787380365.258187:0:3639:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1787380365.258207:0:3639:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9d6fc30d8a80 x1874203867480192/t4294967310(4294967310) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787380381 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1787380365.258218:0:3639:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6fc30d8a80/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787380365.258223:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867480192:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1787380365.258445:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6fc30dad80/2, rc 0, transno 4294967311 00000100:00100000:0.0:1787380365.258460:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867480064:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787380365.259165:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2400:x1874203848538880:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 Request processed in 11922us (12691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380365.259175:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 49 00000100:00100000:1.0:1787380365.264073:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380365.267135:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848539264 00000100:00100000:0.0:1787380365.267150:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848539264 00000100:00100000:0.0:1787380365.267216:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 137 00000100:00100000:0.0:1787380365.267225:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+16:11378:x1874203848539264:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787380365.267269:0:10154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380365.267428:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6962d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ade5 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.267447:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d6ec241b300) 00010000:00010000:0.0:1787380365.267459:0:10154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380365.267491:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69650 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.267522:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69650 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.267531:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69650 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787380365.267627:0:10154:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005cbe012f reply state 000000008c38553d transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69650 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.267638:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69650 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.267645:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d6ec241b300) 00010000:00010000:0.0:1787380365.267647:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787380365.267828:0:10154:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787380365.267983:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+17:11378:x1874203848539264:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 757us (3917us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1787380365.267990:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 137 00000100:00100000:3.0:1787380365.270177:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380365.273169:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848539392 00000100:00100000:1.0:1787380365.273182:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848539392 00000100:00100000:1.0:1787380365.273303:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 52 00000100:00100000:1.0:1787380365.273313:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2399:x1874203848539392:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787380365.273452:0:12152:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787380365.273456:0:12152:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1787380365 -> 1787380365 00002000:00010000:1.0:1787380365.273458:0:12152:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1787380364 00002000:00010000:1.0:1787380365.273460:0:12152:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1787380365 -> 1787380365 00002000:00010000:1.0:1787380365.273462:0:12152:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1787380365.273525:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2399:x1874203848539392:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 213us (3354us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787380365.273532:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 52 00000100:00100000:3.0:1787380365.276879:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380365.277036:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848539648 00000100:00100000:0.0:1787380365.277046:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848539648 00000100:00100000:0.0:1787380365.277091:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 138 00000100:00100000:0.0:1787380365.277101:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+17:11378:x1874203848539648:12345-192.168.206.30@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787380365.277157:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69657 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.277172:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69611 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0add7 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.277181:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69657 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.277223:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69611 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0add7 expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.277237:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69611 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0add7 expref: 17 pid: 6521 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380365.277248:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d06300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874203867480448:192.168.206.30@tcp:104: 00000100:00100000:0.0:1787380365.277325:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb833540 going to sleep for 11 seconds 00000100:00100000:3.0:1787380365.286341:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380365.287141:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d06300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874203867480448:192.168.206.30@tcp:104: 00010000:00010000:0.0:1787380365.287166:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69657 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380365.287238:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848539776 00000100:00100000:2.0:1787380365.287259:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848539776 00010000:00010000:2.0:1787380365.287301:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69611 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0add7 expref: 18 pid: 6521 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380365.287329:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 73 00000100:00100000:2.0:1787380365.287338:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:2400:x1874203848539776:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380365.287351:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380365.287357:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69611 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0add7 expref: 18 pid: 6521 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.287434:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69611 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0add7 expref: 18 pid: 6521 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.287514:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69611 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0add7 expref: 18 pid: 6521 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.287530:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d6ec241b300) 00010000:00010000:2.0:1787380365.287535:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69657 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.287544:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69657 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.287551:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69657 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.287610:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380365.287665:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+17:2400:x1874203848539776:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 317us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380365.287685:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 73 00010000:00010000:0.0:1787380365.290639:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69657 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.290704:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69657 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.290805:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69657 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.291003:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69657 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.291010:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69657 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.291015:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380365.291020:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69657 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.291042:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69657 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.291057:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d6ec241b300) 00010000:00010000:0.0:1787380365.291060:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787380365.291064:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69657 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.291070:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69657 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380365.291180:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+16:11378:x1874203848539648:12345-192.168.206.30@tcp:55:lhsmtool_posix.0 Request processed in 14078us (14304us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787380365.291189:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 138 00000100:00100000:1.0:1787380365.306125:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380365.306214:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848539904 00000100:00100000:2.0:1787380365.306223:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848539904 00000100:00100000:2.0:1787380365.306277:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 53 00000100:00100000:2.0:1787380365.306286:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2398:x1874203848539904:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787380365.306327:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad6965e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.306345:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d8e012e/0xcf3c46fdcad6963b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adf3 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.306354:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380365.306358:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787380365.306363:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad6965e lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.306395:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d8e012e/0xcf3c46fdcad6963b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adf3 expref: 7 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.306409:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d8e012e/0xcf3c46fdcad6963b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adf3 expref: 7 pid: 8435 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380365.306422:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3e9d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1874203867480576:192.168.206.30@tcp:104: 00000100:00100000:2.0:1787380365.306496:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787380365.311097:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380365.311214:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3e9d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8436:1874203867480576:192.168.206.30@tcp:104: 00010000:00010000:0.0:1787380365.311238:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad6965e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380365.311319:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848540032 00000100:00100000:3.0:1787380365.311325:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848540032 00010000:00010000:3.0:1787380365.311357:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d8e012e/0xcf3c46fdcad6963b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adf3 expref: 8 pid: 8435 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380365.311394:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 74 00000100:00100000:3.0:1787380365.311403:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3359500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2399:x1874203848540032:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380365.311422:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380365.311443:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d8e012e/0xcf3c46fdcad6963b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adf3 expref: 8 pid: 8435 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.311455:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d8e012e/0xcf3c46fdcad6963b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adf3 expref: 8 pid: 8435 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.311476:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d8e012e/0xcf3c46fdcad6963b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adf3 expref: 8 pid: 8435 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.311490:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787380365.311494:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787380365.311499:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad6965e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.311508:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad6965e lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.311537:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380365.311581:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3359500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2399:x1874203848540032:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 179us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380365.311588:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 74 00010000:00010000:2.0:1787380365.312063:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad6965e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.312073:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad6965e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.312092:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad6965e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.312100:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad6965e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.312108:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad6965e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.312116:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0e000 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380365.312120:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad6965e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.312129:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad6965e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.312141:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad6965e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.312148:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bad08b8/0xcf3c46fdcad6965e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380365.312220:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2398:x1874203848539904:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 Request processed in 5934us (6102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380365.312228:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 53 00000100:00100000:2.0:1787380365.315238:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380365.315325:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848540288 00000100:00100000:1.0:1787380365.315333:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848540288 00000100:00100000:1.0:1787380365.315385:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 139 00000100:00100000:1.0:1787380365.315395:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+16:11378:x1874203848540288:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787380365.315463:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69665 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.315493:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69554 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad9f expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.315502:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69665 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.315531:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69554 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad9f expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.315543:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69554 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad9f expref: 16 pid: 6521 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380365.315560:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3fedf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867480704:192.168.206.30@tcp:104: 00000100:00100000:1.0:1787380365.315626:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5d58480 going to sleep for 11 seconds 00000100:00100000:2.0:1787380365.322593:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380365.322802:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3fedf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867480704:192.168.206.30@tcp:104: 00010000:00010000:1.0:1787380365.322866:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69665 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380365.323142:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848540416 00000100:00100000:3.0:1787380365.323149:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848540416 00010000:00010000:3.0:1787380365.323179:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69554 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad9f expref: 17 pid: 6521 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380365.323229:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 75 00000100:00100000:3.0:1787380365.323238:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+17:2400:x1874203848540416:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380365.323251:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380365.323257:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69554 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad9f expref: 17 pid: 6521 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.323267:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69554 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad9f expref: 17 pid: 6521 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.323286:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69554 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad9f expref: 17 pid: 6521 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.323300:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:3.0:1787380365.323305:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ec00/0xcf3c46fdcad695b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adc2 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.323313:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69665 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.323320:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69665 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.323327:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69665 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.323352:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380365.323401:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+16:2400:x1874203848540416:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 164us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380365.323414:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 75 00010000:00010000:2.0:1787380365.323477:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69665 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.323486:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69665 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.323627:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad6966c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.323639:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6961f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adde expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.323646:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad6966c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.323683:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6961f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adde expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.323696:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6961f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adde expref: 16 pid: 6522 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380365.323707:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867480832:192.168.206.30@tcp:104: 00000100:00100000:2.0:1787380365.323773:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956480 going to sleep for 11 seconds 00000100:00100000:0.0:1787380365.326307:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380365.326404:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867480832:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380365.326427:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad6966c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380365.327119:0:10339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848540544 00000100:00100000:1.0:1787380365.327125:0:10339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848540544 00010000:00010000:1.0:1787380365.327159:0:10339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6961f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adde expref: 17 pid: 6522 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380365.327205:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 76 00000100:00100000:1.0:1787380365.327215:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+17:2399:x1874203848540544:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380365.327227:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380365.327244:0:10339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6961f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adde expref: 17 pid: 6522 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.327255:0:10339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6961f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adde expref: 17 pid: 6522 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.327274:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad6961f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adde expref: 17 pid: 6522 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.327297:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d6ec241b300) 00010000:00010000:1.0:1787380365.327302:0:10339:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad6966c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.327310:0:10339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad6966c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.327317:0:10339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad6966c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.327340:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380365.327388:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+16:2399:x1874203848540544:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 174us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380365.327395:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 76 00010000:00010000:2.0:1787380365.327550:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad6966c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380365.327558:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad6966c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787380365.327657:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1787380365.327776:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1787380365.327846:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1787380365.327917:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874203867480960:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787380365.327956:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380365.327974:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956240 going to sleep for 11 seconds 00000100:00100000:1.0:1787380365.329302:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867480960 00000100:00100000:1.0:1787380365.329312:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867480960 00000100:00100000:1.0:1787380365.329365:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787380365.329374:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6523:x1874203867480960:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787380365.329923:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6523:x1874203867480960:12345-0@lo:1000:mdt00_002.0 Request processed in 549us (1965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380365.329948:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787380365.339347:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17faa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874203867480960:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787380365.340638:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1787380365.340950:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874203867481088:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787380365.341116:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380365.341187:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc7b560c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380365.342518:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867481088 00000100:00100000:1.0:1787380365.342529:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867481088 00000100:00100000:1.0:1787380365.342862:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787380365.342872:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1874203867481088:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787380365.343152:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6523:x1874203867481088:12345-0@lo:1000:mdt00_002.0 Request processed in 282us (2036us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787380365.343160:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787380365.343446:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d06a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874203867481088:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787380365.343489:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad6966c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.343521:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad6966c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.343527:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad6966c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.343533:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0e000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380365.343537:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad6966c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.343544:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad6966c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.343557:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d6ec241b300) 00010000:00010000:0.0:1787380365.343560:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787380365.343564:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad6966c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.343570:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad6966c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.343592:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad695af lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.343597:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad695af lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.343603:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad695af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.343607:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380365.343616:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad695af lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.343622:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad695af lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.343630:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:0.0:1787380365.343632:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787380365.343638:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ec00/0xcf3c46fdcad695b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adc2 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.343709:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ec00/0xcf3c46fdcad695b6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adc2 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.343720:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ec00/0xcf3c46fdcad695b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adc2 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.343918:0:6523:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ec00/0xcf3c46fdcad695b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adc2 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380365.343930:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3e9d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867481216:192.168.206.30@tcp:105: 00000100:00100000:0.0:1787380365.344098:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc7b560c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380365.349390:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380365.349505:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848540672 00000100:00100000:3.0:1787380365.349513:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848540672 00000100:00100000:3.0:1787380365.349565:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 31 00000100:00100000:3.0:1787380365.349575:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+20:11377:x1874203848540672:12345-192.168.206.30@tcp:49:lfs.0 00000100:00100000:3.0:1787380365.349693:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+20:11377:x1874203848540672:12345-192.168.206.30@tcp:49:lfs.0 Request processed in 119us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380365.349700:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 31 00000100:00100000:1.0:1787380365.350023:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3e9d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867481216:192.168.206.30@tcp:105: 00010000:00010000:1.0:1787380365.350046:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad695af lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.350056:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad695af lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.350084:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad69673 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.350096:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad69673 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.350106:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad69673 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.351867:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad69673 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.351875:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad69673 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.351908:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad69673 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.351913:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380365.351917:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad69673 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.351925:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad69673 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.351938:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:1.0:1787380365.351942:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380365.351946:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad69673 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.351952:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad69673 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.351966:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69665 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.351973:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69665 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.351979:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69665 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.351985:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1c00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380365.351987:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69665 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.352004:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69665 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.352013:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:1.0:1787380365.352016:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787380365.352019:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69665 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.352024:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69665 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380365.352242:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:11378:x1874203848540288:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 36845us (37007us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787380365.352252:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 139 00000020:00080000:1.0:1787380365.352257:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787380365.352613:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787380365.352618:0:13800:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787380365.353103:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787380365.353180:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787380365.355749:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380365.355953:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848540928 00000100:00100000:3.0:1787380365.355963:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848540928 00000100:00100000:3.0:1787380365.356012:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 140 00000100:00100000:3.0:1787380365.356021:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:11377:x1874203848540928:12345-192.168.206.30@tcp:58:lfs.0 00000040:00080000:3.0:1787380365.356172:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787380365.356242:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:11377:x1874203848540928:12345-192.168.206.30@tcp:58:lfs.0 Request processed in 222us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380365.356250:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 140 00000100:00100000:1.0:1787380365.362710:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380365.362882:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848541184 00000100:00100000:3.0:1787380365.362891:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848541184 00000100:00100000:3.0:1787380365.362954:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 32 00000100:00100000:3.0:1787380365.362964:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7be0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:11378:x1874203848541184:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787380365.363221:0:14176:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787380365.363255:0:14176:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1787380365.363284:0:14176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad6967a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.363312:0:14176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad6967a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.363323:0:14176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad6967a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.363331:0:14176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad6967a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.363337:0:14176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad6967a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.363343:0:14176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad6967a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.363359:0:14176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787380365.363432:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7be0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+21:11378:x1874203848541184:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 469us (728us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787380365.363440:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 32 00000020:00080000:3.0:1787380365.363445:0:14176:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787380365.364091:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380365.364098:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad6967a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.364115:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d800 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380365.364119:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad6967a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.364126:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad6967a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.364138:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d6ec241b300) 00010000:00010000:1.0:1787380365.364141:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787380365.364155:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad6967a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.364161:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad6967a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380365.364173:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380365.364174:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380365.364176:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380365.389051:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380365.408638:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380365.408906:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848541312 00000100:00100000:0.0:1787380365.408916:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848541312 00000100:00100000:0.0:1787380365.409014:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 141 00000100:00100000:0.0:1787380365.409024:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+21:11380:x1874203848541312:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1787380365.409058:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380365.409076:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69681 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0adfa expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.409134:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69688 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.409148:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69688 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.409159:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69688 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.409173:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6968f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.409180:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6968f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.409186:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6968f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.409254:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69696 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.409266:0:10154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad695a1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adbb expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.409274:0:10154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69696 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.409405:0:10154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad695a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adbb expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.409425:0:10154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad695a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adbb expref: 22 pid: 6523 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380365.409436:0:10154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f29180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10154:1874203867481344:192.168.206.30@tcp:104: 00000100:00100000:0.0:1787380365.409541:0:10154:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc7b56540 going to sleep for 11 seconds 00000100:00100000:3.0:1787380365.411734:0:10154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f29180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10154:1874203867481344:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380365.411847:0:10154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69696 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380365.412337:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380365.412415:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848541568 00000100:00100000:0.0:1787380365.412422:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848541568 00000100:00100000:0.0:1787380365.412466:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:0.0:1787380365.412475:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+23:6166:x1874203848541568:12345-192.168.206.30@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787380365.412662:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+24:6166:x1874203848541568:12345-192.168.206.30@tcp:35:ldlm_bl.0 Request processed in 187us (325us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1787380365.412670:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:0.0:1787380365.414918:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380365.414982:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848541696 00000100:00100000:3.0:1787380365.415002:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848541696 00010000:00010000:3.0:1787380365.415035:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad695a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adbb expref: 24 pid: 6523 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380365.415070:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 77 00000100:00100000:3.0:1787380365.415078:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+24:2399:x1874203848541696:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380365.415090:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380365.415096:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad695a1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adbb expref: 24 pid: 6523 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.415205:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad695a1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adbb expref: 24 pid: 6523 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.415280:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad695a1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adbb expref: 24 pid: 6523 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.415295:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:3.0:1787380365.415300:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69696 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.415308:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.415379:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69696 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380365.415413:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380365.415467:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+23:2399:x1874203848541696:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 389us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380365.415484:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 77 00010000:00010000:0.0:1787380365.415596:0:10154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.415603:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380365.415661:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787380365.415665:0:10154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787380365.415683:0:10154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.415694:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.415713:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69688 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.415719:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69688 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.415725:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69688 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.415730:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380365.415734:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69688 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.415745:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69688 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.415975:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:0.0:1787380365.415978:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380365.415982:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69688 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.415987:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad69688 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.415998:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6968f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.416004:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6968f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.416009:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6968f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.416019:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380365.416022:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6968f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.416027:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6968f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.416034:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9d6ec26f4c00) 00010000:00010000:0.0:1787380365.416037:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380365.416039:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6968f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.416044:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6968f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.416076:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69681 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adfa expref: 23 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.416088:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69696 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adfa expref: 22 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380365.416095:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:0.0:1787380365.416098:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380365.416100:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867400, rc 0) 00000100:00100000:0.0:1787380365.416142:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:11380:x1874203848541312:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 7120us (7514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380365.416150:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 141 00000001:00080000:2.0:1787380365.775997:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1787380365.776013:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:2.0:1787380366.413342:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787380366.413422:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787380366.413428:0:13800:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787380366.413464:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787380366.413474:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787380366.413595:0:13800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f25880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1874203867481472:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787380366.413680:0:13800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec2779b40 going to sleep for 11 seconds 00000040:00080000:0.0:1787380366.419730:0:14266:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787380366.419744:0:14266:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787380366.419779:0:14266:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787380366.419785:0:14266:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787380366.424334:0:13800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f25880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1874203867481472:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787380366.434398:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380366.434673:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848541824 00000100:00100000:0.0:1787380366.434684:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848541824 00000100:00100000:0.0:1787380366.434758:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 142 00000100:00100000:0.0:1787380366.434768:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:11391:x1874203848541824:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787380366.434802:0:6522:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787380366.434934:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:11391:x1874203848541824:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 168us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380366.434942:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 142 00000100:00080000:2.0:1787380366.436757:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380366.438476:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380366.438572:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848542080 00000100:00100000:0.0:1787380366.438581:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848542080 00000100:00100000:0.0:1787380366.438727:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 143 00000100:00100000:0.0:1787380366.438739:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:11391:x1874203848542080:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380366.438758:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380366.438776:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6969d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae01 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.438950:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad696a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.438966:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad696a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380366.438977:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad696a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380366.438987:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787380366.440246:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6969d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae01 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380366.440269:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad696a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae01 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380366.440278:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:1.0:1787380366.440339:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380366.440343:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867c00, rc 0) 00000100:00100000:1.0:1787380366.440508:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+24:11391:x1874203848542080:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 1771us (2038us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1787380366.440516:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 143 00000100:00100000:1.0:1787380366.450736:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380366.450834:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380366.450872:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848542464 00000100:00100000:1.0:1787380366.450884:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848542464 00000100:00100000:1.0:1787380366.450953:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 144 00000100:00100000:1.0:1787380366.450965:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+24:11391:x1874203848542464:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787380366.451060:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0600/0xcf3c46fdcad696b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380366.451092:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0600/0xcf3c46fdcad696b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380366.451106:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0600/0xcf3c46fdcad696b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380366.451278:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0600/0xcf3c46fdcad696b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380366.451286:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0600/0xcf3c46fdcad696b2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380366.451292:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0600/0xcf3c46fdcad696b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380366.451299:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df0600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380366.451303:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0600/0xcf3c46fdcad696b2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380366.451310:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0600/0xcf3c46fdcad696b2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380366.451321:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:1.0:1787380366.451324:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787380366.451328:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0600/0xcf3c46fdcad696b2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380366.451335:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0600/0xcf3c46fdcad696b2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380366.451458:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+25:11391:x1874203848542464:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 494us (622us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787380366.451474:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 144 00000100:00100000:3.0:1787380366.452070:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848542208 00000100:00100000:3.0:1787380366.452079:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848542208 00000100:00100000:3.0:1787380366.452131:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:3.0:1787380366.452141:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+25:2400:x1874203848542208:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380366.452153:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380366.452171:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad696a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae01 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380366.452186:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:3.0:1787380366.452190:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380366.452225:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+24:2400:x1874203848542208:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 86us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380366.452232:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 11 00000040:00080000:3.0:1787380366.452331:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787380366.452336:0:13800:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787380366.452797:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787380366.452830:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787380366.465264:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380366.465303:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848542720 00000100:00100000:0.0:1787380366.465312:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848542720 00000100:00100000:0.0:1787380366.465359:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00100000:0.0:1787380366.465368:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+24:11391:x1874203848542720:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787380366.465552:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+25:11391:x1874203848542720:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 185us (295us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787380366.465560:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00100000:3.0:1787380366.988121:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380366.988143:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867481600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787380366.988255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380366.988431:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867481600 00000100:00100000:1.0:1787380366.988439:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867481600 00000100:00100000:1.0:1787380366.988568:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787380366.988588:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867481600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787380366.988623:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380366.988680:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867481600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380366.988687:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787380366.989921:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380366.989936:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867481728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380366.989996:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380366.990136:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867481728 00000100:00100000:1.0:1787380366.990142:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867481728 00000100:00100000:1.0:1787380366.990207:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787380366.990226:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867481728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380366.990251:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380366.990302:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867481728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380366.990309:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787380366.990343:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1787380366.990362:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:1.0:1787380366.990380:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6ec310a680, transno 4294967302 00000004:00080000:1.0:1787380366.990389:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1787380366.990398:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6ec3fee300, transno 4294967305 00000100:00100000:1.0:1787380366.990410:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867481728:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787380366.991032:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787380366.991086:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3feea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867481600:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787380366.993280:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867481984:0@lo:400:kworker.0 00000100:00100000:3.0:1787380366.993368:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380366.993420:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867482496:0@lo:400:kworker.0 00000100:00100000:3.0:1787380366.993487:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380366.993524:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867483008:0@lo:400:kworker.0 00000100:00100000:0.0:1787380366.993758:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867481856:0@lo:400:kworker.0 00000100:00100000:0.0:1787380366.993848:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380366.993884:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867482368:0@lo:400:kworker.0 00000100:00100000:0.0:1787380366.993931:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380366.993957:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867482880:0@lo:400:kworker.0 00000100:00100000:0.0:1787380366.993993:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380366.994014:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787380366.994036:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867482240:0@lo:400:kworker.0 00000100:00100000:0.0:1787380366.994085:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867481856 00000100:00100000:0.0:1787380366.994091:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867481856 00000100:00100000:0.0:1787380366.994177:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1787380366.994186:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3642:x1874203867481856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380366.994285:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3642:x1874203867481856:12345-0@lo:400:kworker.0 Request processed in 98us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380366.994316:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1787380366.994362:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867481984 00000100:00100000:0.0:1787380366.994366:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867481984 00000100:00100000:0.0:1787380366.994388:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867482496 00000100:00100000:0.0:1787380366.994391:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867482496 00000100:00100000:0.0:1787380366.994413:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787380366.994418:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867481984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380366.994449:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867481984:12345-0@lo:400:kworker.0 Request processed in 30us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380366.994455:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787380366.994465:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787380366.994470:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867482496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380366.994495:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867482496:12345-0@lo:400:kworker.0 Request processed in 25us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380366.994501:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:0.0:1787380366.994532:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380366.994717:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867482112:0@lo:400:kworker.0 00000100:00100000:2.0:1787380366.994762:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380366.994784:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867482624:0@lo:400:kworker.0 00000100:00100000:2.0:1787380366.994901:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867482880 00000100:00100000:2.0:1787380366.994906:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867482880 00000100:00100000:2.0:1787380366.994953:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787380366.994989:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3642:x1874203867482880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380366.995078:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3642:x1874203867482880:12345-0@lo:400:kworker.0 Request processed in 90us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380366.995085:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787380366.995136:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867482368 00000100:00100000:2.0:1787380366.995153:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867482368 00000100:00100000:2.0:1787380366.995199:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867482112 00000100:00100000:2.0:1787380366.995203:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867482112 00000100:00100000:2.0:1787380366.995251:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787380366.995259:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867482368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380366.995301:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867482368:12345-0@lo:400:kworker.0 Request processed in 44us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380366.995317:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787380366.995329:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787380366.995335:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867482112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380366.995383:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867482112:12345-0@lo:400:kworker.0 Request processed in 48us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380366.995389:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787380366.996727:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380366.997332:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867483008 00000100:00100000:1.0:1787380366.997338:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867483008 00000100:00100000:1.0:1787380366.997415:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787380366.997436:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867483008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380366.997501:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867483008:12345-0@lo:400:kworker.0 Request processed in 68us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380366.997508:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1787380366.997649:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867481984:0@lo:400:kworker.0 00000100:00100000:3.0:1787380366.997671:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867482496:0@lo:400:kworker.0 00000100:00100000:3.0:1787380366.997699:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867483008:0@lo:400:kworker.0 00000100:00080000:1.0:1787380366.997800:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380366.997938:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3fee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867483264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380366.997976:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380366.998021:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380366.998046:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1874203867483136:0@lo:400:kworker.0 00000100:00100000:2.0:1787380366.998070:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380366.998233:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867482624 00000100:00100000:1.0:1787380366.998252:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867482624 00000100:00100000:1.0:1787380366.998313:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867483136 00000100:00100000:1.0:1787380366.998317:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867483136 00000100:00100000:1.0:1787380366.998355:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787380366.998362:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867482624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380366.998408:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867482624:12345-0@lo:400:kworker.0 Request processed in 47us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380366.998414:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787380366.998427:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787380366.998432:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874203867483136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380366.998577:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867483264 00000100:00100000:0.0:1787380366.998582:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867483264 00000100:00100000:0.0:1787380366.998649:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787380366.998656:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867483264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787380366.998725:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1787380366.998797:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867483264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380366.998804:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:0.0:1787380366.998953:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787380366.999004:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380366.999048:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867482752:0@lo:400:kworker.0 00000100:00100000:0.0:1787380366.999129:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380366.999177:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867481856:0@lo:400:kworker.0 00000100:00100000:0.0:1787380366.999199:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867482368:0@lo:400:kworker.0 00000100:00100000:0.0:1787380366.999214:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867482880:0@lo:400:kworker.0 00000100:00100000:0.0:1787380366.999249:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867482240 00000100:00100000:0.0:1787380366.999263:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867482240 00000100:00100000:0.0:1787380366.999288:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787380366.999294:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867482240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380366.999355:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867482240:12345-0@lo:400:kworker.0 Request processed in 61us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380366.999362:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1787380366.999389:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867482240:0@lo:400:kworker.0 00000100:00100000:0.0:1787380366.999415:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867482752 00000100:00100000:0.0:1787380366.999419:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867482752 00000100:00100000:0.0:1787380366.999448:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787380366.999455:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867482752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380366.999488:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867482752:12345-0@lo:400:kworker.0 Request processed in 34us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380366.999494:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1787380366.999507:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380366.999522:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867482752:0@lo:400:kworker.0 00000100:00100000:3.0:1787380367.000446:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3fee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867483264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787380367.002590:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1874203867483136:12345-0@lo:400:kworker.0 Request processed in 4135us (4496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380367.002616:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00010000:00080000:2.0:1787380367.012417:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3ccaa00 x1874203867483136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380367.012442:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3640:1874203867483136:0@lo:400:kworker.0 00000100:00100000:2.0:1787380367.012493:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867482112:0@lo:400:kworker.0 00010000:00080000:2.0:1787380367.012506:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3f24380 x1874203867482624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380367.012522:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867482624:0@lo:400:kworker.0 00010000:00010000:1.0:1787380367.436251:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380367.500723:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867483392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380367.500798:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380367.500945:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867483392 00000100:00100000:2.0:1787380367.500952:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867483392 00000100:00100000:2.0:1787380367.501009:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787380367.501019:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3642:x1874203867483392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380367.501042:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787380367.501087:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3642:x1874203867483392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380367.501093:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787380367.501149:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867483392:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787380367.501459:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380367.502012:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3fef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867483520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380367.502051:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380367.502190:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867483520 00000100:00100000:0.0:1787380367.502196:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867483520 00000100:00100000:0.0:1787380367.502231:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787380367.502238:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867483520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787380367.502251:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787380367.502296:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867483520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380367.502302:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787380367.502422:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3fef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867483520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380367.524926:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380367.524971:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380367.525011:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380367.525029:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380367.525047:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380367.525087:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380367.525107:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380367.525133:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848543104 00000100:00100000:3.0:1787380367.525141:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848543104 00000100:00100000:3.0:1787380367.525183:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848543616 00000100:00100000:3.0:1787380367.525186:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848543616 00000100:00100000:3.0:1787380367.525198:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848543488 00000100:00100000:3.0:1787380367.525200:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848543488 00000100:00100000:3.0:1787380367.525210:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848542976 00000100:00100000:3.0:1787380367.525212:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848542976 00000100:00100000:3.0:1787380367.525225:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 286 00000100:00100000:3.0:1787380367.525234:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848543104:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380367.525443:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848542848 00000100:00100000:1.0:1787380367.525448:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848542848 00000100:00100000:1.0:1787380367.525487:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 380 00000100:00100000:1.0:1787380367.525494:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2398:x1874203848542848:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380367.525566:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848543360 00000100:00100000:2.0:1787380367.525571:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848543360 00000100:00100000:2.0:1787380367.525602:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848543232 00000100:00100000:2.0:1787380367.525606:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848543232 00000100:00100000:2.0:1787380367.525632:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 106 00000100:00100000:2.0:1787380367.525640:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848543360:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380367.525661:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848543104:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 426us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380367.525670:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 286 00000100:00100000:3.0:1787380367.526610:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 287 00000100:00100000:3.0:1787380367.526619:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848543616:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380367.530406:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2398:x1874203848542848:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 4901us (5478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380367.530421:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 380 00000100:00100000:1.0:1787380367.530560:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 288 00000100:00100000:1.0:1787380367.530572:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848543488:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380367.530620:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848543488:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 52us (5532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380367.530627:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 288 00000100:00100000:1.0:1787380367.531397:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 289 00000100:00100000:1.0:1787380367.531408:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+25:2397:x1874203848542976:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380367.531571:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+25:2397:x1874203848542976:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 44us (6340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380367.531581:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 289 00000100:00100000:1.0:1787380367.532019:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 107 00000100:00100000:1.0:1787380367.532035:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffcb19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2398:x1874203848543232:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380367.532037:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848543360:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 6391us (7018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380367.532069:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffcb19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2398:x1874203848543232:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 41us (7019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380367.532075:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 107 00000100:00080000:1.0:1787380367.532114:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787380367.532119:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787380367.532122:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787380367.532124:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787380367.534211:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 106 00000100:00100000:3.0:1787380367.538628:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848543616:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 11998us (13584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380367.538653:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 287 00000040:00080000:1.0:1787380368.319232:0:14318:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787380368.319240:0:14318:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787380368.319268:0:14318:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787380368.319276:0:14318:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787380368.461978:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380368.500155:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380368.500294:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848543872 00000100:00100000:1.0:1787380368.500303:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848543872 00000100:00100000:1.0:1787380368.500367:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 145 00000100:00100000:1.0:1787380368.500390:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+25:11413:x1874203848543872:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1787380368.500409:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1787380368.500520:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787380368.500590:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1400/0xcf3c46fdcad696b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae08 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380368.500744:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad696c0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380368.500757:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad696c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380368.500767:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad696c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380368.500777:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787380368.500923:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1400/0xcf3c46fdcad696b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae08 expref: 28 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380368.500942:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad696c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae08 expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380368.500951:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:1.0:1787380368.500955:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787380368.500958:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df0e00, rc 0) 00000100:00100000:1.0:1787380368.501106:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+27:11413:x1874203848543872:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 718us (958us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1787380368.501114:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 145 00000100:00100000:0.0:1787380368.505279:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380368.506098:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848544000 00000100:00100000:2.0:1787380368.506109:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848544000 00000100:00100000:2.0:1787380368.506216:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 146 00000100:00100000:2.0:1787380368.506227:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+27:11413:x1874203848544000:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:2.0:1787380368.506457:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad696ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380368.506473:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad696ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380368.506484:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad696ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380368.506516:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad696ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380368.506522:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad696ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380368.506527:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad696ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380368.506532:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0ea00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380368.506536:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad696ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380368.506542:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad696ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380368.506552:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:2.0:1787380368.506555:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787380368.506572:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad696ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380368.506578:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad696ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380368.506651:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+27:11413:x1874203848544000:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 425us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380368.506659:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 146 00000100:00100000:3.0:1787380368.524083:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3fedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867483648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787380368.524145:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380368.524485:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867483648 00000100:00100000:1.0:1787380368.524493:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867483648 00000100:00100000:1.0:1787380368.524556:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787380368.524565:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867483648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380368.524596:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380368.524649:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867483648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380368.524656:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787380368.524875:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3fedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867483648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787380368.568962:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380368.569052:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848544128 00000100:00100000:3.0:1787380368.569061:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848544128 00000100:00100000:3.0:1787380368.569115:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 54 00000100:00100000:3.0:1787380368.569133:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2397:x1874203848544128:12345-192.168.206.30@tcp:101:cat.0 00010000:00010000:3.0:1787380368.569148:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380368.569165:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a28fe2da/0xcf3c46fdcad696d5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae0f expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787380368.569185:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a89428d, atime: 0x6a89428c, ctime: 0x6a89428d, blocks: 0x8 00010000:00010000:3.0:1787380368.569203:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:3.0:1787380368.569206:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380368.569214:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a28fe2da/0xcf3c46fdcad696d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae0f expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380368.569230:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a28fe2da/0xcf3c46fdcad696d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae0f expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380368.569241:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89cc00, rc 0) 00000100:00100000:3.0:1787380368.569524:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2397:x1874203848544128:12345-192.168.206.30@tcp:101:cat.0 Request processed in 392us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380368.569531:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 54 00000100:00100000:0.0:1787380368.572628:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380368.572757:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848544256 00000100:00100000:1.0:1787380368.572765:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848544256 00002000:00100000:1.0:1787380368.572805:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9d6ec3f28000 x1874203848544256/t0(0) o3->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:174/0 lens 488/0 e 0 to 0 dl 1787380379 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787380368.572831:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec3f28000 with x1874203848544256 ext(0->4095) 00002000:00010000:1.0:1787380368.572836:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d6ec3f28000 00000100:00100000:1.0:1787380368.572948:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:1.0:1787380368.572957:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2398:x1874203848544256:12345-192.168.206.30@tcp:3:cat.0 00000100:00100000:1.0:1787380368.573107:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2398:x1874203848544256:12345-192.168.206.30@tcp:3:cat.0 Request processed in 151us (485us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787380368.573115:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 3 00002000:00100000:1.0:1787380368.573120:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9d6ec3f28000 x1874203848544256/t0(0) o3->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:174/0 lens 488/4536 e 0 to 0 dl 1787380379 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787380368.573128:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec3f28000 with x1874203848544256 ext(0->4095) 00002000:00010000:1.0:1787380368.573131:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d6ec3f28000 00010000:00010000:2.0:1787380369.484108:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380370.508414:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787380370.574969:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1787380370.574983:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1787380370.575511:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1787380370.575536:0:6500:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d6ffb833600 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787380370.575541:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ffc910e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d6ffb833540 00000020:00080000:2.0:1787380370.575544:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ffc910500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d6fc53c4c00 00000020:00080000:2.0:1787380370.575564:0:6500:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:1.0:1787380370.575718:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69650 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380370.575729:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69650 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380370.575747:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69650 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380370.575842:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380370.575848:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69650 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380370.575856:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69650 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380370.575880:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9d6ec241b300) 00010000:00010000:1.0:1787380370.575883:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380370.575888:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69650 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380370.575895:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69650 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787380370.575967:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1787380370.576035:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1787380371.534720:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787380371.596108:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787380371.596117:0:13800:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787380371.596137:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787380371.596147:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787380371.788562:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787380372.108043:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867483776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380372.108111:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380372.108520:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867483776 00000100:00100000:0.0:1787380372.108527:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867483776 00000100:00100000:0.0:1787380372.108574:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787380372.108583:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867483776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787380372.108614:0:13003:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1787380372.108658:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867483776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380372.108665:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787380372.109439:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867484032:0@lo:400:kworker.0 00000100:00100000:0.0:1787380372.109482:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380372.109524:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867484544:0@lo:400:kworker.0 00000100:00100000:0.0:1787380372.109548:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380372.109564:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867485056:0@lo:400:kworker.0 00000100:00100000:0.0:1787380372.109597:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380372.109632:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787380372.109638:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867484160:0@lo:400:kworker.0 00000100:00100000:0.0:1787380372.109661:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380372.109676:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867484672:0@lo:400:kworker.0 00000100:00100000:0.0:1787380372.109697:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380372.109711:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867485184:0@lo:400:kworker.0 00000100:00100000:0.0:1787380372.109749:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380372.109771:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867484544 00000100:00100000:0.0:1787380372.109777:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867484544 00000100:00100000:0.0:1787380372.109841:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867485056 00000100:00100000:0.0:1787380372.109845:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867485056 00000100:00100000:0.0:1787380372.109857:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867484160 00000100:00100000:0.0:1787380372.109871:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867484160 00000100:00100000:0.0:1787380372.109883:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867484672 00000100:00100000:0.0:1787380372.109886:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867484672 00000100:00100000:0.0:1787380372.109898:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867485184 00000100:00100000:0.0:1787380372.109900:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867485184 00000100:00100000:0.0:1787380372.109914:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787380372.109921:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867484544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380372.110274:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867484544:12345-0@lo:400:kworker.0 Request processed in 352us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380372.110281:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1787380372.110298:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787380372.110305:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867485056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380372.110334:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867485056:12345-0@lo:400:kworker.0 Request processed in 30us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380372.110352:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787380372.110364:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787380372.110369:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867484160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380372.110397:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867484160:12345-0@lo:400:kworker.0 Request processed in 28us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380372.110402:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1787380372.110410:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787380372.110416:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867484672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380372.110441:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867484672:12345-0@lo:400:kworker.0 Request processed in 25us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380372.110446:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787380372.110457:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1787380372.110463:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867485184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380372.110485:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867485184:12345-0@lo:400:kworker.0 Request processed in 23us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380372.110490:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:0.0:1787380372.110507:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787380372.110511:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380372.110537:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867484160:0@lo:400:kworker.0 00010000:00080000:0.0:1787380372.110549:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fd17f9500 x1874203867484672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380372.110559:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867484672:0@lo:400:kworker.0 00010000:00080000:0.0:1787380372.110568:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc3b67b80 x1874203867485184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380372.110587:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867485184:0@lo:400:kworker.0 00000100:00100000:0.0:1787380372.110598:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867484544:0@lo:400:kworker.0 00000100:00100000:0.0:1787380372.110605:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867485056:0@lo:400:kworker.0 00000100:00100000:3.0:1787380372.111015:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867483904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787380372.111051:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380372.111080:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867484416:0@lo:400:kworker.0 00000100:00100000:3.0:1787380372.111102:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380372.111121:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867484928:0@lo:400:kworker.0 00000100:00100000:3.0:1787380372.111379:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380372.111399:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867485440:0@lo:400:kworker.0 00000100:00100000:3.0:1787380372.111419:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380372.111438:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787380372.111444:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867484288:0@lo:400:kworker.0 00000100:00100000:3.0:1787380372.111463:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380372.111477:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867484800:0@lo:400:kworker.0 00000100:00100000:3.0:1787380372.111494:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380372.111506:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867485312:0@lo:400:kworker.0 00000100:00100000:3.0:1787380372.111521:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380372.111547:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867484416 00000100:00100000:3.0:1787380372.111552:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867484416 00000100:00100000:3.0:1787380372.111583:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787380372.111589:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867484416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380372.111642:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867484416:12345-0@lo:400:kworker.0 Request processed in 52us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380372.111649:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787380372.111677:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867484928 00000100:00100000:3.0:1787380372.111681:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867484928 00000100:00100000:3.0:1787380372.111709:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867485440 00000100:00100000:3.0:1787380372.111713:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867485440 00000100:00100000:2.0:1787380372.112093:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867484032 00000100:00100000:2.0:1787380372.112098:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867484032 00000100:00100000:2.0:1787380372.112139:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1787380372.112147:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867484032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380372.112188:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867484032:12345-0@lo:400:kworker.0 Request processed in 42us (2705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380372.112194:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1787380372.112222:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867484288 00000100:00100000:2.0:1787380372.112225:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867484288 00000100:00100000:2.0:1787380372.112247:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787380372.112253:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867484288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380372.112293:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867484288:12345-0@lo:400:kworker.0 Request processed in 40us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380372.112300:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787380372.112318:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867484800 00000100:00100000:2.0:1787380372.112322:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867484800 00000100:00100000:2.0:1787380372.112336:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867485312 00000100:00100000:2.0:1787380372.112339:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867485312 00000100:00100000:2.0:1787380372.112352:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787380372.112358:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867484928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380372.112386:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867484928:12345-0@lo:400:kworker.0 Request processed in 28us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380372.112392:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787380372.112405:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787380372.112411:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867484800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380372.112433:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867484800:12345-0@lo:400:kworker.0 Request processed in 23us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380372.112439:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787380372.112447:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787380372.112452:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867485312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380372.112475:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867485312:12345-0@lo:400:kworker.0 Request processed in 23us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380372.112480:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787380372.112514:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867484032:0@lo:400:kworker.0 00000100:00100000:2.0:1787380372.112579:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867483776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380372.112632:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867484288:0@lo:400:kworker.0 00000100:00100000:2.0:1787380372.112654:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867484800:0@lo:400:kworker.0 00000100:00100000:2.0:1787380372.112663:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867485312:0@lo:400:kworker.0 00000100:00100000:2.0:1787380372.112672:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867484416:0@lo:400:kworker.0 00000100:00100000:2.0:1787380372.112680:0:3642:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1787380372.112684:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6fc30d8a80, transno 4294967310 00000004:00080000:2.0:1787380372.112693:0:3642:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6fc30dad80, transno 4294967311 00000004:00080000:2.0:1787380372.112697:0:3642:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1787380372.112710:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867484928:0@lo:400:kworker.0 00000100:00080000:2.0:1787380372.112912:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787380372.112916:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380372.117109:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867483904 00000100:00100000:0.0:1787380372.117123:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867483904 00000100:00100000:0.0:1787380372.117501:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787380372.117511:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867483904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787380372.117543:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380372.117636:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867483904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (6574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380372.117643:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1787380372.117702:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867483904:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787380372.118470:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787380372.118478:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867485440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380372.118521:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867485440:12345-0@lo:400:kworker.0 Request processed in 45us (7101us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380372.118527:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1787380372.118551:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787380372.121469:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867485440:0@lo:400:kworker.0 00000100:00100000:3.0:1787380372.121601:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787380372.121612:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867485568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380372.121679:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380372.121736:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867485568 00000100:00100000:3.0:1787380372.121742:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867485568 00000100:00100000:3.0:1787380372.121785:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787380372.121794:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867485568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787380372.121838:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380372.121886:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867485568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380372.121894:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787380372.121932:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867485568:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787380372.570803:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380372.619990:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380372.620011:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867485696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380372.620075:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380372.621346:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867485696 00000100:00100000:0.0:1787380372.621356:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867485696 00000100:00100000:0.0:1787380372.621399:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787380372.621408:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867485696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787380372.621448:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787380372.621505:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867485696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380372.621512:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1787380372.621966:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867485696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787380372.621971:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787380372.621987:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867485824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380372.622022:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380372.622089:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867485824 00000100:00100000:3.0:1787380372.622093:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867485824 00000100:00100000:3.0:1787380372.622127:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1787380372.622133:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867485824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787380372.622155:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787380372.622201:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867485824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380372.622207:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1787380372.622390:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867485824:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380372.650991:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380372.651032:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380372.651570:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848544384 00000100:00100000:0.0:1787380372.651580:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848544384 00000100:00100000:1.0:1787380372.651609:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380372.651639:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 382 00000100:00100000:1.0:1787380372.651649:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380372.651649:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2397:x1874203848544384:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380372.651734:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2397:x1874203848544384:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 73us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380372.651742:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 382 00000100:00100000:1.0:1787380372.652314:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848544896 00000100:00100000:1.0:1787380372.652328:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848544896 00000100:00100000:1.0:1787380372.652378:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 112 00000100:00100000:1.0:1787380372.652401:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2397:x1874203848544896:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380372.652447:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2397:x1874203848544896:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 61us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380372.652454:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 112 00000100:00080000:3.0:1787380372.652912:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787380372.653103:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848544640 00000100:00100000:2.0:1787380372.653109:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848544640 00000100:00100000:2.0:1787380372.653182:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848545152 00000100:00100000:2.0:1787380372.653186:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848545152 00000100:00100000:1.0:1787380372.653251:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 296 00000100:00100000:1.0:1787380372.653260:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2397:x1874203848544640:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380372.653301:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2397:x1874203848544640:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 42us (2268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380372.653308:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 296 00000100:00100000:1.0:1787380372.653448:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380372.653527:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380372.653549:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380372.653565:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848544512 00000100:00100000:1.0:1787380372.653568:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848544512 00000100:00080000:3.0:1787380372.653964:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787380372.653969:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787380372.654085:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848545024 00000100:00100000:2.0:1787380372.654089:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848545024 00000100:00100000:2.0:1787380372.654108:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 297 00000100:00100000:2.0:1787380372.654114:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848545152:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380372.654155:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848545152:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 41us (2504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380372.654162:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 297 00000100:00100000:2.0:1787380372.654175:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 298 00000100:00100000:2.0:1787380372.654181:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848545024:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380372.654205:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3feea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2397:x1874203848545024:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 26us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380372.654224:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 298 00000100:00100000:2.0:1787380372.654410:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848544768 00000100:00100000:2.0:1787380372.654414:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848544768 00000100:00100000:2.0:1787380372.654456:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 113 00000100:00100000:2.0:1787380372.654463:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2397:x1874203848544768:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380372.654494:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2397:x1874203848544768:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 32us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380372.654501:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 113 00000100:00100000:1.0:1787380372.657264:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 299 00000100:00100000:1.0:1787380372.657277:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+13:2397:x1874203848544512:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380372.657356:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+13:2397:x1874203848544512:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 81us (3907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380372.657363:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 299 00000100:00080000:3.0:1787380372.658338:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787380372.658346:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380373.275029:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380373.275214:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848545280 00000100:00100000:0.0:1787380373.275224:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848545280 00000100:00100000:0.0:1787380373.275286:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 147 00000100:00100000:0.0:1787380373.275297:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+13:11066:x1874203848545280:12345-192.168.206.30@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787380373.275394:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+13:11066:x1874203848545280:12345-192.168.206.30@tcp:60:lhsmtool_posix.0 Request processed in 99us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380373.275402:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 147 00000100:00100000:2.0:1787380373.282488:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380373.282624:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848545408 00000100:00100000:1.0:1787380373.282633:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848545408 00000100:00100000:1.0:1787380373.282685:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 148 00000100:00100000:1.0:1787380373.282695:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:11066:x1874203848545408:12345-192.168.206.30@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787380373.282805:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:11066:x1874203848545408:12345-192.168.206.30@tcp:60:lhsmtool_posix.0 Request processed in 111us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380373.282850:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 148 00000100:00100000:1.0:1787380373.288119:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380373.288220:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848545664 00000100:00100000:0.0:1787380373.288230:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848545664 00000100:00100000:0.0:1787380373.288288:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 35 00000100:00100000:0.0:1787380373.288297:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+13:11066:x1874203848545664:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787380373.288521:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+14:11066:x1874203848545664:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 224us (409us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787380373.288529:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 35 00010000:00010000:1.0:1787380373.581638:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380373.614381:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380373.615509:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848545792 00000100:00100000:2.0:1787380373.615521:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848545792 00000100:00100000:2.0:1787380373.615595:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 149 00000100:00100000:2.0:1787380373.615604:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:11872:x1874203848545792:12345-192.168.206.30@tcp:101:lsof.0 00010000:00010000:2.0:1787380373.615622:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380373.615640:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad696dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae16 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380373.615696:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad696e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380373.615709:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad696e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380373.615720:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad696e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380373.615760:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787380373.615774:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787380373.615851:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad696e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380373.615886:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad696dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae16 expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380373.615904:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad696e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae16 expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380373.615913:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec241b400) 00010000:00010000:2.0:1787380373.615916:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787380373.615919:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0fe00, rc 0) 00000100:00100000:2.0:1787380373.615974:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:11872:x1874203848545792:12345-192.168.206.30@tcp:101:lsof.0 Request processed in 371us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380373.615981:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 149 00000100:00100000:2.0:1787380373.645504:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787380373.645526:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fff66d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867485952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787380373.645592:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380373.649073:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867485952 00000100:00100000:1.0:1787380373.649087:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867485952 00000100:00100000:1.0:1787380373.649423:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787380373.649434:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867485952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380373.649480:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380373.649562:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867485952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (3969us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380373.649569:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787380373.649656:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fff66d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867485952:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787380374.606043:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380375.628643:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380376.652859:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787380376.723033:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1787380376.723048:0:6500:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1787380376.723071:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1787380376.723079:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:1.0:1787380377.029398:0:14515:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 02:32:56 (1787380376) 00000100:00100000:3.0:1787380377.227968:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787380377.227989:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867486080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380377.228050:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380377.228107:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867486080 00000100:00100000:3.0:1787380377.228114:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867486080 00000100:00100000:3.0:1787380377.228163:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1787380377.228172:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867486080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787380377.228199:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380377.228239:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867486080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380377.228247:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1787380377.228273:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787380377.228310:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867486080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380377.228490:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867486592:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.228521:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380377.228541:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867487104:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.228576:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380377.228591:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867487616:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.228609:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380377.228632:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787380377.228638:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867486208:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.228661:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380377.228680:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867486720:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.228701:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380377.228716:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867487232:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.228734:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380377.228756:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867486336:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.228777:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380377.228793:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867486848:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.228845:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380377.228862:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867487360:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.228881:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380377.228898:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1787380377.228903:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867486464:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.228922:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380377.228934:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1874203867486976:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.228952:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380377.228964:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867487488:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.228982:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380377.229004:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867486592 00000100:00100000:2.0:1787380377.229014:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867486592 00000100:00100000:2.0:1787380377.229053:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867486336 00000100:00100000:2.0:1787380377.229057:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867486336 00000100:00100000:2.0:1787380377.229068:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867486848 00000100:00100000:2.0:1787380377.229070:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867486848 00000100:00100000:2.0:1787380377.229084:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867487360 00000100:00100000:2.0:1787380377.229087:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867487360 00000100:00100000:2.0:1787380377.229098:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867486976 00000100:00100000:2.0:1787380377.229100:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867486976 00000100:00100000:2.0:1787380377.229109:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867487488 00000100:00100000:2.0:1787380377.229111:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867487488 00000100:00100000:2.0:1787380377.229123:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787380377.229129:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867486592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.229167:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867486592:12345-0@lo:400:kworker.0 Request processed in 39us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380377.229173:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787380377.229188:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787380377.229193:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867486336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.229224:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867486336:12345-0@lo:400:kworker.0 Request processed in 31us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380377.229230:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787380377.229243:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787380377.229248:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867486848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.229277:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867486848:12345-0@lo:400:kworker.0 Request processed in 29us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380377.229283:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787380377.229294:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787380377.229299:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867487360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.229337:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867487360:12345-0@lo:400:kworker.0 Request processed in 38us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380377.229344:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787380377.229356:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787380377.229362:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874203867486976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.229386:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874203867486976:12345-0@lo:400:kworker.0 Request processed in 25us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380377.229391:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787380377.229402:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787380377.229408:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874203867487488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.229432:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874203867487488:12345-0@lo:400:kworker.0 Request processed in 25us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380377.229438:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787380377.229457:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867487104 00000100:00100000:2.0:1787380377.229461:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867487104 00000100:00100000:2.0:1787380377.229484:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867487616 00000100:00100000:2.0:1787380377.229487:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867487616 00000100:00100000:2.0:1787380377.229502:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867487232 00000100:00100000:2.0:1787380377.229504:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867487232 00000100:00100000:2.0:1787380377.229516:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787380377.229521:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867487104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.229550:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867487104:12345-0@lo:400:kworker.0 Request processed in 29us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380377.229556:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787380377.229566:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787380377.229572:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867487616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.229606:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867487616:12345-0@lo:400:kworker.0 Request processed in 34us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380377.229611:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787380377.229623:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787380377.229629:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867487232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.229655:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867487232:12345-0@lo:400:kworker.0 Request processed in 26us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380377.229660:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787380377.229677:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867486208 00000100:00100000:2.0:1787380377.229680:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867486208 00000100:00100000:2.0:1787380377.229713:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1787380377.229719:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7bcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867486208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.229747:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7bcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867486208:12345-0@lo:400:kworker.0 Request processed in 28us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380377.229753:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1787380377.229778:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867486720 00000100:00100000:2.0:1787380377.229782:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867486720 00000100:00100000:2.0:1787380377.229826:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867486464 00000100:00100000:2.0:1787380377.229830:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867486464 00000100:00100000:2.0:1787380377.229856:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787380377.229862:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867486720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.229893:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867486720:12345-0@lo:400:kworker.0 Request processed in 31us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380377.229900:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787380377.229911:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787380377.229917:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867486464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.229955:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867486464:12345-0@lo:400:kworker.0 Request processed in 38us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380377.229961:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787380377.230014:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867486464:0@lo:400:kworker.0 00010000:00080000:2.0:1787380377.230027:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff5d99500 x1874203867486976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380377.230036:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5d99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1874203867486976:0@lo:400:kworker.0 00010000:00080000:2.0:1787380377.230045:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3d79c00 x1874203867487488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380377.230053:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867487488:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.230062:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867486336:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.230071:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867486848:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.230080:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867487360:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.230116:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867486208:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.230125:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867486720:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.230133:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867487232:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.230142:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867486592:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.230150:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867487104:0@lo:400:kworker.0 00000100:00100000:2.0:1787380377.230158:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867487616:0@lo:400:kworker.0 00000100:00080000:3.0:1787380377.230375:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787380377.230380:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787380377.230383:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787380377.230385:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380377.230394:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867487744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380377.230423:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380377.230464:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867487744 00000100:00100000:3.0:1787380377.230468:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867487744 00000100:00100000:3.0:1787380377.230492:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787380377.230498:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867487744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787380377.230520:0:13003:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1787380377.230550:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867487744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380377.230555:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787380377.230594:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867487744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380377.237277:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867487872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787380377.237344:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380377.239728:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867487872 00000100:00100000:2.0:1787380377.239747:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867487872 00000100:00100000:2.0:1787380377.239823:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787380377.239843:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867487872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787380377.239865:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380377.239931:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867487872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (2587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380377.239938:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787380377.241830:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867487872:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1787380377.676047:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380377.740054:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787380377.740076:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867488000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787380377.740140:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380377.740291:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867488000 00000100:00100000:3.0:1787380377.740299:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867488000 00000100:00100000:3.0:1787380377.740348:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787380377.740357:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867488000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787380377.740384:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787380377.740424:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867488000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380377.740430:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787380377.740453:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380377.740468:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867488128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380377.740565:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380377.740567:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867488000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380377.740634:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867488128 00000100:00100000:3.0:1787380377.740639:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867488128 00000100:00100000:3.0:1787380377.740668:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787380377.740675:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867488128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787380377.740686:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1787380377.740724:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867488128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380377.740746:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787380377.741279:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc478fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867488128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380377.757116:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380377.757161:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380377.757195:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380377.757307:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380377.757320:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848546304 00000100:00100000:1.0:1787380377.757330:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848546304 00000100:00100000:3.0:1787380377.757335:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380377.757394:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 117 00000100:00100000:1.0:1787380377.757404:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2397:x1874203848546304:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380377.757485:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2397:x1874203848546304:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 83us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380377.757494:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 117 00000100:00080000:1.0:1787380377.757516:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787380377.757544:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848545920 00000100:00100000:1.0:1787380377.757547:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848545920 00000100:00100000:1.0:1787380377.757579:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 384 00000100:00100000:1.0:1787380377.757587:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2398:x1874203848545920:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380377.757612:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2398:x1874203848545920:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 26us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380377.757619:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 384 00000100:00100000:3.0:1787380377.761525:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380377.761559:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380377.761773:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848546048 00000100:00100000:0.0:1787380377.761783:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848546048 00000100:00100000:0.0:1787380377.761868:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848546560 00000100:00100000:0.0:1787380377.761872:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848546560 00000100:00100000:0.0:1787380377.761887:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848546176 00000100:00100000:0.0:1787380377.761890:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848546176 00000100:00100000:0.0:1787380377.761924:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 306 00000100:00100000:0.0:1787380377.761933:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+13:2397:x1874203848546048:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380377.761973:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 307 00000100:00100000:1.0:1787380377.761985:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2397:x1874203848546560:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380377.762069:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2397:x1874203848546560:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 86us (4872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380377.762077:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 307 00000100:00100000:1.0:1787380377.762097:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 308 00000100:00100000:0.0:1787380377.762104:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+13:2397:x1874203848546048:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 170us (4995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380377.762109:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848546176:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380377.762117:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 306 00000100:00100000:1.0:1787380377.762142:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848546176:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 37us (4807us total) trans 0 rc 0/0 00000100:00080000:0.0:1787380377.762146:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787380377.762151:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 308 00000100:00080000:0.0:1787380377.762152:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380377.762196:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848546432 00000100:00100000:1.0:1787380377.762200:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848546432 00000100:00100000:1.0:1787380377.762247:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 118 00000100:00100000:1.0:1787380377.762255:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848546432:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380377.762291:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848546432:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 38us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380377.762298:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 118 00000100:00080000:1.0:1787380377.762324:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787380377.764217:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848546688 00000100:00100000:0.0:1787380377.764730:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848546688 00000100:00100000:0.0:1787380377.764875:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 309 00000100:00100000:0.0:1787380377.764885:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848546688:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380377.764969:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848546688:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 85us (3408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380377.764977:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 309 00000100:00080000:1.0:1787380377.766107:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787380378.543375:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380378.543439:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848546944 00000100:00100000:1.0:1787380378.543448:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848546944 00000100:00100000:1.0:1787380378.543510:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 150 00000100:00100000:1.0:1787380378.543519:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+13:12139:x1874203848546944:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787380378.543537:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380378.543554:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad696ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae1d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.543615:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad696f1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.543628:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad696f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.543640:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad696f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.543655:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad696f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.543661:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad696f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.543668:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad696f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.543762:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad696ff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.543771:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad696ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.543778:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad696ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380378.543787:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787380378.543896:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad696f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.543904:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad696f1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.543910:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad696f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.543916:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df0200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380378.543920:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad696f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.543938:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad696f1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.543949:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d6ec241b500) 00010000:00010000:1.0:1787380378.543952:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380378.543956:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad696f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.543973:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad696f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.543993:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad696f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.543999:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad696f8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.544005:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad696f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.544010:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380378.544013:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad696f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.544019:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad696f8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.544026:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d6ec3030f00) 00010000:00010000:1.0:1787380378.544028:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380378.544030:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad696f8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.544036:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad696f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.544296:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad696ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae1d expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.544310:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad696ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae1d expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380378.544324:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6ec25a8300) 00010000:00010000:1.0:1787380378.544326:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380378.544328:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df1600, rc 0) 00000100:00100000:1.0:1787380378.544388:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+15:12139:x1874203848546944:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 869us (1021us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1787380378.544396:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 150 00000100:00100000:3.0:1787380378.549541:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380378.549688:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380378.549750:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848547200 00000100:00100000:2.0:1787380378.549760:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848547200 00000100:00100000:2.0:1787380378.549847:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:2.0:1787380378.549858:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd62b6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+15:2397:x1874203848547200:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380378.549873:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380378.549901:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad696ff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae1d expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380378.549910:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848547072 00000100:00100000:0.0:1787380378.549916:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848547072 00010000:00010000:2.0:1787380378.549918:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6ec25a8300) 00010000:00010000:2.0:1787380378.549924:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380378.549990:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd62b6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+15:2397:x1874203848547200:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 121us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380378.549997:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:0.0:1787380378.550102:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 151 00000100:00100000:0.0:1787380378.550111:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+14:12139:x1874203848547072:12345-192.168.206.30@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787380378.550201:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+14:12139:x1874203848547072:12345-192.168.206.30@tcp:59:lhsmtool_posix.0 Request processed in 91us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380378.550209:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 151 00000100:00100000:3.0:1787380378.557104:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380378.559764:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848547328 00000100:00100000:2.0:1787380378.559794:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848547328 00000100:00100000:2.0:1787380378.560109:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 152 00000100:00100000:2.0:1787380378.560120:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:12139:x1874203848547328:12345-192.168.206.30@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787380378.560223:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:12139:x1874203848547328:12345-192.168.206.30@tcp:59:lhsmtool_posix.0 Request processed in 105us (3128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380378.560230:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 152 00010000:00010000:1.0:1787380378.699984:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380378.768792:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fff66dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867488256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787380378.768897:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380378.769143:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867488256 00000100:00100000:2.0:1787380378.769152:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867488256 00000100:00100000:2.0:1787380378.769205:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787380378.769215:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867488256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787380378.769251:0:13003:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1787380378.769306:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867488256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380378.769313:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787380378.769361:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fff66dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867488256:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1787380378.776694:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787380378.776704:0:13800:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787380378.777183:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787380378.777192:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1787380378.956727:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787380379.723922:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380380.437244:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380380.437514:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848547456 00000100:00100000:2.0:1787380380.437523:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848547456 00000100:00080000:0.0:1787380380.437695:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380380.437752:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 153 00000100:00100000:2.0:1787380380.437771:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+14:12181:x1874203848547456:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1787380380.437787:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380380.437805:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad6970d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae24 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.437907:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad69714 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.437922:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad69714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.437946:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad69714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.437961:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad6971b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.437968:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad6971b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.437975:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad6971b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.438013:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad69714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.438020:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad69714 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.438026:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad69714 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.438032:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0ea00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380380.438036:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad69714 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.438043:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad69714 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.438053:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec241b400) 00010000:00010000:2.0:1787380380.438056:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380380.438059:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad69714 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.438070:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad69714 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.438083:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad6971b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.438088:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad6971b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.438094:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad6971b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.438099:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0f800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380380.438102:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad6971b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.438108:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad6971b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.438114:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d6fc4767500) 00010000:00010000:2.0:1787380380.438116:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380380.438119:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad6971b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.438125:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad6971b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.438151:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad6970d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae24 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.438169:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec241b400) 00010000:00010000:2.0:1787380380.438171:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380380.438175:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad6970d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae24 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.438184:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0f000, rc 0) 00000100:00100000:2.0:1787380380.438239:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+14:12181:x1874203848547456:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 479us (1002us total) trans 0 rc 301/301 00000100:00100000:2.0:1787380380.438246:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 153 00000100:00100000:0.0:1787380380.450749:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380380.450897:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848547712 00000100:00100000:3.0:1787380380.450917:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848547712 00000100:00100000:2.0:1787380380.451025:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 154 00000100:00100000:2.0:1787380380.451035:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+14:12181:x1874203848547712:12345-192.168.206.30@tcp:36:lfs.0 00010000:00010000:2.0:1787380380.451085:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380380.451108:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdba00/0xcf3c46fdcad69061 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac48 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.451124:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec241b400) 00010000:00010000:2.0:1787380380.451129:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380380.451179:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69722 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.451191:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad696e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae16 expref: 5 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.451198:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69722 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.451244:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad696e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae16 expref: 5 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.451258:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad696e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae16 expref: 5 pid: 6522 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380380.451271:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d06300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874203867488384:192.168.206.30@tcp:104: 00000100:00100000:2.0:1787380380.451363:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3de3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380380.457146:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380380.457230:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d06300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874203867488384:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380380.457257:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69722 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380380.457313:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848547840 00000100:00100000:0.0:1787380380.457320:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848547840 00010000:00010000:0.0:1787380380.457380:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad696e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae16 expref: 6 pid: 6522 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787380380.457500:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380380.457552:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 78 00000100:00100000:0.0:1787380380.457563:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2399:x1874203848547840:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380380.457576:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380380.457583:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad696e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae16 expref: 6 pid: 6522 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.457597:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad696e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae16 expref: 6 pid: 6522 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.457619:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fe00/0xcf3c46fdcad696e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae16 expref: 6 pid: 6522 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.457634:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec241b400) 00010000:00010000:0.0:1787380380.457639:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69722 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.457647:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69722 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.457654:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69722 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.457681:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380380.457736:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2399:x1874203848547840:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 174us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380380.457744:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 78 00010000:00010000:1.0:1787380380.457804:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69722 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.457861:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69722 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.457887:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0800/0xcf3c46fdcad69729 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.457898:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0800/0xcf3c46fdcad69729 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.457919:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0800/0xcf3c46fdcad69729 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.458564:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1800/0xcf3c46fdcad69730 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.458576:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1800/0xcf3c46fdcad69730 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.458584:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1800/0xcf3c46fdcad69730 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787380380.458607:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ffb9739 reply state 00000000444cd3d4 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1800/0xcf3c46fdcad69730 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.458620:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1800/0xcf3c46fdcad69730 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.458626:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:1.0:1787380380.458629:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787380380.458631:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787380380.458637:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787380380.458644:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69722 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.458651:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69722 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.458656:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69722 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.458662:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0f000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380380.458665:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69722 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.458672:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69722 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.458680:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec241b400) 00010000:00010000:1.0:1787380380.458682:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380380.458685:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69722 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.458701:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69722 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787380380.458725:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ffb9739 reply state 00000000444cd3d4 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0800/0xcf3c46fdcad69729 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.458732:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0800/0xcf3c46fdcad69729 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.458738:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d6ec3030f00) 00010000:00010000:1.0:1787380380.458740:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787380380.458741:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1787380380.458845:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+15:12181:x1874203848547712:12345-192.168.206.30@tcp:36:lfs.0 Request processed in 7809us (8101us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787380380.458853:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 154 00000100:00100000:3.0:1787380380.542174:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380380.542481:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848547968 00000100:00100000:0.0:1787380380.542490:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848547968 00000100:00100000:0.0:1787380380.542551:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 155 00000100:00100000:0.0:1787380380.542561:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+15:12189:x1874203848547968:12345-192.168.206.30@tcp:101:lctl.0 00010000:00010000:0.0:1787380380.542593:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380380.542616:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69737 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae2b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.542673:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad6973e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.542685:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad6973e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.542696:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad6973e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380380.542737:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787380380.542740:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787380380.542759:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad6973e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.542781:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69737 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae2b expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.542798:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad6973e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae2b expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.542867:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec26f4200) 00010000:00010000:0.0:1787380380.542870:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787380380.542884:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867600, rc 0) 00000100:00100000:0.0:1787380380.542937:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+16:12189:x1874203848547968:12345-192.168.206.30@tcp:101:lctl.0 Request processed in 378us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380380.542944:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 155 00000100:00100000:3.0:1787380380.597607:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380380.597859:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848548096 00000100:00100000:1.0:1787380380.597867:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848548096 00000100:00100000:1.0:1787380380.597924:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 156 00000100:00100000:1.0:1787380380.597933:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+16:12195:x1874203848548096:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:1.0:1787380380.597952:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380380.597972:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0c00/0xcf3c46fdcad69745 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae32 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598032:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6974c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598045:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6974c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598072:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6974c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598083:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69753 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598090:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69753 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598096:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69753 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598161:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0600/0xcf3c46fdcad6975a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598169:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0600/0xcf3c46fdcad6975a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598176:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0600/0xcf3c46fdcad6975a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380380.598208:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1787380380.598212:0:10154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787380380.598230:0:10154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0600/0xcf3c46fdcad6975a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598240:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6974c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598245:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6974c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598262:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6974c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598267:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df0a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380380.598271:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6974c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598277:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6974c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598305:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec26f4200) 00010000:00010000:1.0:1787380380.598308:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380380.598312:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6974c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598317:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6974c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598329:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69753 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598334:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69753 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598339:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69753 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598343:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1e00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380380.598345:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69753 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598359:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69753 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598366:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d6ec3030f00) 00010000:00010000:1.0:1787380380.598368:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380380.598370:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69753 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598375:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69753 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598399:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0c00/0xcf3c46fdcad69745 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae32 expref: 18 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598411:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0600/0xcf3c46fdcad6975a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae32 expref: 17 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.598418:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:1.0:1787380380.598420:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787380380.598422:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df0600, rc 0) 00000100:00100000:1.0:1787380380.598478:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+17:12195:x1874203848548096:12345-192.168.206.30@tcp:101:bash.0 Request processed in 546us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380380.598486:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 156 00000100:00100000:3.0:1787380380.605650:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380380.608015:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848548352 00000100:00100000:0.0:1787380380.608030:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848548352 00000100:00100000:0.0:1787380380.608106:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 157 00000100:00100000:0.0:1787380380.608115:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+17:12195:x1874203848548352:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1787380380.608133:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380380.608150:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69761 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae39 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.608243:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69768 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.608257:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69768 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.608270:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69768 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.608336:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6976f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.608344:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6976f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.608351:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6976f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787380380.608655:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1787380380.609309:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69776 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.609321:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69776 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.609329:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69776 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.609366:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69768 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.609373:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69768 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.609379:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69768 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.609384:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380380.609389:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69768 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.609396:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69768 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.609408:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:0.0:1787380380.609410:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380380.609416:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69768 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.609422:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69768 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787380380.609449:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000088e234c2 reply state 00000000f6ccf36c transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6976f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.609459:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6976f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.609465:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380380.609467:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787380380.609469:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787380380.609553:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69761 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae39 expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.609565:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69776 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae39 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.609572:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4f00) 00010000:00010000:0.0:1787380380.609575:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380380.609577:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866600, rc 0) 00000100:00100000:0.0:1787380380.609649:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+20:12195:x1874203848548352:12345-192.168.206.30@tcp:101:bash.0 Request processed in 1534us (4006us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1787380380.609658:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 157 00000100:00100000:3.0:1787380380.614947:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380380.616443:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848548480 00000100:00100000:0.0:1787380380.616455:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848548480 00000100:00080000:1.0:1787380380.616538:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787380380.616652:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 55 00000100:00100000:0.0:1787380380.616663:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848548480:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1787380380.616678:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380380.616695:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c06ed28a/0xcf3c46fdcad69784 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae40 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380380.616726:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380380.616756:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=390s v=(0 0) 00010000:00010000:0.0:1787380380.616761:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380380.616773:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c06ed28a/0xcf3c46fdcad69784 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae40 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.616789:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c06ed28a/0xcf3c46fdcad69784 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae40 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.616802:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867000, rc 0) 00000100:00100000:0.0:1787380380.616897:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2400:x1874203848548480:12345-192.168.206.30@tcp:101:bash.0 Request processed in 236us (1960us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380380.617188:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 55 00000100:00100000:3.0:1787380380.621222:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380380.621308:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848548608 00000100:00100000:1.0:1787380380.621317:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848548608 00000100:00100000:1.0:1787380380.621369:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 56 00000100:00100000:1.0:1787380380.621378:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:12195:x1874203848548608:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:1.0:1787380380.621404:0:8871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380380.621419:0:8871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c60f572a/0xcf3c46fdcad6978b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae47 expref: -99 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.621448:0:8871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c06ed28a/0xcf3c46fdcad69784 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae40 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.621457:0:8871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380380.621461:0:8871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380380.621466:0:8871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c60f572a/0xcf3c46fdcad6978b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae47 expref: 7 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.621507:0:8871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c06ed28a/0xcf3c46fdcad69784 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae40 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.621520:0:8871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c06ed28a/0xcf3c46fdcad69784 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae40 expref: 7 pid: 8436 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380380.621534:0:8871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fff66d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8871:1874203867488512:192.168.206.30@tcp:104: 00000100:00100000:1.0:1787380380.621620:0:8871:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956180 going to sleep for 11 seconds 00000100:00100000:3.0:1787380380.642751:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380380.642862:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848548736 00000100:00100000:2.0:1787380380.642872:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848548736 00010000:00010000:2.0:1787380380.642911:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c06ed28a/0xcf3c46fdcad69784 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae40 expref: 8 pid: 8436 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380380.642957:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 79 00000100:00100000:2.0:1787380380.642967:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2399:x1874203848548736:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380380.642981:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380380.643000:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c06ed28a/0xcf3c46fdcad69784 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae40 expref: 8 pid: 8436 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.643016:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c06ed28a/0xcf3c46fdcad69784 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae40 expref: 8 pid: 8436 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.643059:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380380.643064:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380380.643072:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c60f572a/0xcf3c46fdcad6978b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae47 expref: 8 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.643081:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c60f572a/0xcf3c46fdcad6978b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae47 expref: 8 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.643114:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c60f572a/0xcf3c46fdcad6978b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae47 expref: 8 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380380.643127:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1874203867488640:192.168.206.30@tcp:105: 00000100:00100000:2.0:1787380380.643200:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3de3cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1787380380.644146:0:8871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c06ed28a/0xcf3c46fdcad69784 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae40 expref: 8 pid: 8436 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380380.644167:0:8871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fff66d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8871:1874203867488512:192.168.206.30@tcp:104: 00010000:00010000:1.0:1787380380.644193:0:8871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c60f572a/0xcf3c46fdcad6978b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae47 expref: 7 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.644228:0:8871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df0c00, rc 0) 00000100:00100000:1.0:1787380380.644272:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:12195:x1874203848548608:12345-192.168.206.30@tcp:101:bash.0 Request processed in 22896us (23058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380380.644291:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 56 00000100:00100000:2.0:1787380380.651417:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d06300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6506:1874203867488640:192.168.206.30@tcp:105: 00010000:00010000:2.0:1787380380.651443:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380380.651505:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2399:x1874203848548736:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 8531us (8756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380380.651515:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 79 00000100:00100000:3.0:1787380380.653860:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380380.653942:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848548992 00000100:00100000:0.0:1787380380.653952:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848548992 00000100:00100000:0.0:1787380380.654008:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 36 00000100:00100000:0.0:1787380380.654017:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+20:12195:x1874203848548992:12345-192.168.206.30@tcp:35:bash.0 00000100:00100000:0.0:1787380380.654281:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+21:12195:x1874203848548992:12345-192.168.206.30@tcp:35:bash.0 Request processed in 265us (479us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787380380.654297:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 36 00000100:00100000:3.0:1787380380.734935:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380380.735741:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848549248 00000100:00100000:1.0:1787380380.735751:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848549248 00000100:00100000:1.0:1787380380.735853:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 158 00000100:00100000:1.0:1787380380.735863:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+21:12205:x1874203848549248:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1787380380.735884:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380380.735903:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69792 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae4e expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380380.736001:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787380380.736276:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69792 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae4e expref: 23 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.736289:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec26f4200) 00010000:00010000:1.0:1787380380.736291:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787380380.736296:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69792 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae4e expref: 23 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.736309:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df1e00, rc 0) 00000100:00100000:1.0:1787380380.736369:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:12205:x1874203848549248:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 508us (1443us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1787380380.736376:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 158 00000100:00100000:3.0:1787380380.743420:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380380.743589:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848549504 00000100:00100000:0.0:1787380380.743599:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848549504 00000100:00100000:0.0:1787380380.743659:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 37 00000100:00100000:0.0:1787380380.743670:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:12205:x1874203848549504:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:0.0:1787380380.743947:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+23:12205:x1874203848549504:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 279us (535us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1787380380.743955:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 37 00010000:00010000:2.0:1787380380.748064:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380380.830931:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380380.830975:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380380.831238:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848549760 00000100:00100000:1.0:1787380380.831252:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848549760 00000100:00100000:1.0:1787380380.831311:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 57 00000100:00100000:1.0:1787380380.831320:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2400:x1874203848549760:12345-192.168.206.30@tcp:16:kworker.0 00000100:00100000:1.0:1787380380.831441:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2400:x1874203848549760:12345-192.168.206.30@tcp:16:kworker.0 Request processed in 121us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380380.831449:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 57 00000100:00100000:0.0:1787380380.831731:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848549632 00000100:00100000:0.0:1787380380.831736:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848549632 00002000:00100000:0.0:1787380380.831763:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9d6ec44bdf80 x1874203848549632/t0(0) o4->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:186/0 lens 504/0 e 0 to 0 dl 1787380391 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380380.831774:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec44bdf80 with x1874203848549632 ext(0->12) 00002000:00010000:0.0:1787380380.831780:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d6ec44bdf80 00000100:00100000:0.0:1787380380.831844:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:0.0:1787380380.831854:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2400:x1874203848549632:12345-192.168.206.30@tcp:4:bash.0 00000100:00100000:0.0:1787380380.834440:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2400:x1874203848549632:12345-192.168.206.30@tcp:4:bash.0 Request processed in 2580us (3508us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787380380.834463:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 4 00002000:00100000:0.0:1787380380.834473:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9d6ec44bdf80 x1874203848549632/t4294967306(0) o4->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:186/0 lens 504/448 e 0 to 0 dl 1787380391 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380380.834483:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec44bdf80 with x1874203848549632 ext(0->12) 00002000:00010000:0.0:1787380380.834489:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9d6ec44bdf80 00000100:00100000:3.0:1787380380.903789:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380380.903997:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848549888 00000100:00100000:2.0:1787380380.904006:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848549888 00000100:00100000:2.0:1787380380.904059:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 159 00000100:00100000:2.0:1787380380.904068:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+23:12211:x1874203848549888:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1787380380.904089:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380380.904117:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad697a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae55 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.904182:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad697a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.904195:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad697a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.904207:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad697a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380380.904261:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1787380380.904264:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787380380.904284:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad697a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.904307:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad697a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae55 expref: 25 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.904323:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad697a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae55 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.904331:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:2.0:1787380380.904334:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787380380.904337:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0ea00, rc 0) 00000100:00100000:2.0:1787380380.904392:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+24:12211:x1874203848549888:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 325us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380380.904399:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 159 00000100:00100000:3.0:1787380380.907800:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380380.908029:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848550144 00000100:00100000:1.0:1787380380.908037:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848550144 00000100:00100000:1.0:1787380380.908086:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 160 00000100:00100000:1.0:1787380380.908094:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+24:12211:x1874203848550144:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1787380380.908111:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380380.908128:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad697ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae5c expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.908239:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad697b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.908252:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad697b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.908263:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad697b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380380.908272:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787380380.908362:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad697ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae5c expref: 27 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.908378:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad697b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae5c expref: 26 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380380.908401:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4f00) 00010000:00010000:1.0:1787380380.908404:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380380.908407:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df0a00, rc 0) 00000100:00100000:1.0:1787380380.908469:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+26:12211:x1874203848550144:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 375us (676us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1787380380.908476:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 160 00000100:00100000:3.0:1787380380.918872:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380380.918913:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380380.919035:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848550400 00000100:00100000:2.0:1787380380.919057:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848550400 00000100:00100000:2.0:1787380380.919118:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 161 00000100:00100000:2.0:1787380380.919129:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+26:12211:x1874203848550400:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1787380380.919152:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380380.919173:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad697c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae63 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.919287:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e800/0xcf3c46fdcad697ca lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.919300:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e800/0xcf3c46fdcad697ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.919311:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e800/0xcf3c46fdcad697ca lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380380.919322:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787380380.919416:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad697c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae63 expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.919433:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e800/0xcf3c46fdcad697ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae63 expref: 28 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.919442:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4f00) 00010000:00010000:2.0:1787380380.919445:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787380380.919461:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0e800, rc 0) 00000100:00100000:2.0:1787380380.919521:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+28:12211:x1874203848550400:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 394us (658us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1787380380.919528:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 161 00000100:00100000:0.0:1787380380.919977:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848550528 00000100:00100000:0.0:1787380380.919982:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848550528 00000100:00100000:0.0:1787380380.920018:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:0.0:1787380380.920025:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+28:2398:x1874203848550528:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380380.920034:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380380.920049:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad697b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae5c expref: 28 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.920065:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4f00) 00010000:00010000:0.0:1787380380.920068:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380380.920101:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+27:2398:x1874203848550528:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 76us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380380.920107:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:3.0:1787380380.939084:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380380.939756:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848550656 00000100:00100000:0.0:1787380380.939765:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848550656 00000100:00100000:0.0:1787380380.939858:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00100000:0.0:1787380380.939868:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2399:x1874203848550656:12345-192.168.206.30@tcp:1:lfs.0 00010000:00010000:0.0:1787380380.939909:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad697d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.939928:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c60f572a/0xcf3c46fdcad6978b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae47 expref: 8 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.939936:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787380380.939941:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787380380.939946:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad697d8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.939976:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c60f572a/0xcf3c46fdcad6978b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae47 expref: 8 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.939989:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c60f572a/0xcf3c46fdcad6978b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae47 expref: 8 pid: 8871 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380380.940028:0:8436:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f29f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1874203867488768:192.168.206.30@tcp:104: 00000100:00100000:0.0:1787380380.940124:0:8436:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec249f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787380380.942889:0:8436:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f29f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8436:1874203867488768:192.168.206.30@tcp:104: 00010000:00010000:0.0:1787380380.942913:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad697d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380380.953650:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380380.954191:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848550784 00000100:00100000:0.0:1787380380.954201:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848550784 00010000:00010000:0.0:1787380380.954252:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c60f572a/0xcf3c46fdcad6978b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae47 expref: 9 pid: 8871 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380380.954297:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 80 00000100:00100000:0.0:1787380380.954307:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:2399:x1874203848550784:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380380.954323:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787380380.954341:0:6507:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787380380.954345:0:6507:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1787380381 00002000:00010000:0.0:1787380380.954347:0:6507:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1787380381 00002000:00010000:0.0:1787380380.954349:0:6507:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1787380380.954354:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c60f572a/0xcf3c46fdcad6978b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae47 expref: 9 pid: 8871 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.954369:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c60f572a/0xcf3c46fdcad6978b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae47 expref: 9 pid: 8871 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.954409:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c60f572a/0xcf3c46fdcad6978b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae47 expref: 9 pid: 8871 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.954426:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787380380.954431:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787380380.954436:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad697d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.954447:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad697d8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.954481:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380380.954537:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2399:x1874203848550784:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 231us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380380.954545:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 80 00010000:00010000:3.0:1787380380.954757:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad697d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380380.954767:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad697d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380380.954786:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad697d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380380.954795:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad697d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380380.954802:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad697d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380380.954874:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866200 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:3.0:1787380380.954878:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad697d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380380.954886:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad697d8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380380.954898:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad697d8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380380.954906:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad697d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380380.954947:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2399:x1874203848550656:12345-192.168.206.30@tcp:1:lfs.0 Request processed in 15081us (15872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380380.954956:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00100000:1.0:1787380380.963003:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380380.963089:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848551040 00000100:00100000:2.0:1787380380.963098:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848551040 00000100:00100000:2.0:1787380380.963150:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 38 00000100:00100000:2.0:1787380380.963158:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7be2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+27:12211:x1874203848551040:12345-192.168.206.30@tcp:35:lfs.0 00000004:00010000:2.0:1787380380.963225:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e800/0xcf3c46fdcad697ca lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae63 expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787380380.963385:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1787380380.963411:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787380380.963697:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1787380380.963735:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad697df lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.963749:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69776 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae39 expref: 31 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.963757:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad697df lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.963791:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69776 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae39 expref: 31 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.964072:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69776 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae39 expref: 31 pid: 6521 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380380.964087:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d06300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1874203867488896:192.168.206.30@tcp:104: 00000100:00100000:2.0:1787380380.964218:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3de3840 going to sleep for 11 seconds 00000100:00100000:1.0:1787380380.972606:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380380.972734:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848551168 00000100:00100000:0.0:1787380380.972743:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848551168 00010000:00010000:0.0:1787380380.972781:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69776 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae39 expref: 32 pid: 6521 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380380.972858:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 81 00000100:00100000:0.0:1787380380.972868:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+32:2400:x1874203848551168:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380380.972881:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380380.972887:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69776 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae39 expref: 32 pid: 6521 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.972917:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69776 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae39 expref: 32 pid: 6521 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.972937:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4f00) 00010000:00010000:0.0:1787380380.972943:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad697df lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.972952:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad697df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.972959:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad697df lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380380.972975:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380380.973026:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+32:2400:x1874203848551168:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 160us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380380.973034:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 81 00010000:00010000:2.0:1787380380.974333:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69776 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae39 expref: 31 pid: 6521 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380380.974372:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d06300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1874203867488896:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380380.974394:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad697df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.974402:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad697df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.974408:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad697df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787380380.974518:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1787380380.974740:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1787380380.974911:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d06300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874203867489024:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787380380.974968:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380380.975769:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3de3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787380380.980671:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867489024 00000100:00100000:1.0:1787380380.980684:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867489024 00000100:00100000:1.0:1787380380.980764:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787380380.980773:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1874203867489024:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787380380.980938:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1874203867489024:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 165us (5968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380380.980946:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787380380.981169:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d06300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874203867489024:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787380380.981316:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1787380380.981402:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874203867489152:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787380380.981437:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380380.981466:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3378f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787380380.981519:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867489152 00000100:00100000:2.0:1787380380.981524:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867489152 00000100:00100000:2.0:1787380380.981556:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787380380.981573:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1874203867489152:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787380380.981687:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6524:x1874203867489152:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 124us (248us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787380380.981693:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787380380.981981:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874203867489152:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787380380.982020:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1787380380.982055:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad697df lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380380.982073:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad697df lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380380.982080:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad697df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380380.982086:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0f800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380380.982091:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad697df lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380380.982098:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad697df lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380380.982113:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4f00) 00010000:00010000:3.0:1787380380.982116:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787380380.982120:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad697df lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380380.982126:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad697df lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787380380.982228:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787380380.982283:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1787380380.982294:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 391306484768ns, next at 392306482483ns, rc = 0 00000001:00080000:3.0:1787380380.982301:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1787380380.982325:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4f00) 00010000:00010000:3.0:1787380380.982328:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787380380.982334:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e800/0xcf3c46fdcad697ca lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae63 expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380380.982515:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7be2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+34:12211:x1874203848551040:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 19356us (19518us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1787380380.982524:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 38 00000020:00080000:3.0:1787380380.982528:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1787380380.983386:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787380380.994279:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380380.994485:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848551296 00000100:00100000:2.0:1787380380.994495:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848551296 00000100:00100000:2.0:1787380380.994554:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 162 00000100:00100000:2.0:1787380380.994571:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+34:12211:x1874203848551296:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1787380380.994608:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380380.994628:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad697e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae6a expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.994683:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad697e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae6a expref: 35 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.994698:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad697e6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae6a expref: 35 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380380.994715:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:2.0:1787380380.994718:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787380380.994722:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0fa00, rc 0) 00000100:00100000:2.0:1787380380.994774:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+35:12211:x1874203848551296:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 211us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380380.994781:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 162 00000100:00100000:2.0:1787380380.997644:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380380.997740:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848551552 00000100:00100000:0.0:1787380380.997750:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848551552 00000100:00100000:0.0:1787380380.997851:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 39 00000100:00100000:0.0:1787380380.997863:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+35:12211:x1874203848551552:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:0.0:1787380380.998071:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+36:12211:x1874203848551552:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 210us (434us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787380380.998078:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 39 00000040:00080000:1.0:1787380381.005456:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787380381.118359:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380381.118458:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848551808 00000100:00100000:2.0:1787380381.118467:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848551808 00000100:00100000:2.0:1787380381.118525:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 163 00000100:00100000:2.0:1787380381.118534:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+36:12221:x1874203848551808:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1787380381.118556:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380381.118581:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad697ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae71 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380381.118661:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1787380381.118740:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad697ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae71 expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.118766:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec26f4200) 00010000:00010000:2.0:1787380381.118768:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787380381.118772:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad697ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae71 expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.118785:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0fc00, rc 0) 00000100:00100000:2.0:1787380381.118894:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+37:12221:x1874203848551808:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 361us (542us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1787380381.118901:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 163 00000100:00100000:3.0:1787380381.136760:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380381.136899:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848551936 00000100:00100000:2.0:1787380381.136908:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848551936 00000100:00100000:2.0:1787380381.136963:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 164 00000100:00100000:2.0:1787380381.136973:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+37:12221:x1874203848551936:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:2.0:1787380381.137049:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad697fb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137068:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad697fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137079:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad697fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137089:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69802 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137095:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69802 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137117:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69802 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137188:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69809 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137197:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69809 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137216:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69809 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380381.137260:0:10154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69809 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137273:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad697fb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137279:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad697fb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137287:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad697fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137293:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0fc00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380381.137297:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad697fb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137303:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad697fb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137314:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:2.0:1787380381.137322:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380381.137327:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad697fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137334:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad697fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137347:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69802 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137353:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69802 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137360:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69802 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137366:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0f600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380381.137368:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69802 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137373:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69802 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137380:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6ec26f4500) 00010000:00010000:2.0:1787380381.137383:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380381.137386:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69802 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137390:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69802 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137398:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69809 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137408:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69809 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137413:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69809 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137418:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0e200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380381.137421:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69809 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137427:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69809 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137433:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:2.0:1787380381.137435:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380381.137437:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69809 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.137442:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69809 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380381.137505:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+37:12221:x1874203848551936:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 534us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380381.137514:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 164 00000100:00100000:1.0:1787380381.157639:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380381.157753:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848552192 00000100:00100000:3.0:1787380381.157762:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848552192 00000100:00100000:3.0:1787380381.157859:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 40 00000100:00100000:3.0:1787380381.157870:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+37:12221:x1874203848552192:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:3.0:1787380381.158081:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+38:12221:x1874203848552192:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 212us (450us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787380381.158089:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 40 00000100:00100000:3.0:1787380381.223025:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380381.223188:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848552448 00000100:00100000:2.0:1787380381.223197:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848552448 00000100:00100000:2.0:1787380381.223264:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 165 00000100:00100000:2.0:1787380381.223275:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+38:12224:x1874203848552448:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1787380381.223295:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380381.223323:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69810 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae78 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223382:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69817 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223393:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69817 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223403:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69817 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223412:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6981e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223418:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6981e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223422:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6981e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223528:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69825 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223537:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69825 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223544:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69825 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380381.223553:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787380381.223628:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69817 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223644:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69817 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223650:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69817 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223656:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0f600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380381.223660:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69817 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223667:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69817 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223678:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:2.0:1787380381.223681:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380381.223685:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69817 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223691:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad69817 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223705:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6981e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223711:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6981e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223717:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6981e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223722:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0fc00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380381.223731:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6981e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223738:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6981e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223746:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6ec26f4500) 00010000:00010000:2.0:1787380381.223748:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380381.223750:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6981e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.223755:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6981e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.224124:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69810 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae78 expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.224144:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69825 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae78 expref: 40 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.224151:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:2.0:1787380381.224154:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380381.224156:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0e400, rc 0) 00000100:00100000:2.0:1787380381.224223:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+40:12224:x1874203848552448:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 950us (1206us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787380381.224231:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 165 00000100:00100000:1.0:1787380381.235289:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380381.236352:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848552576 00000100:00100000:2.0:1787380381.236363:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848552576 00000100:00100000:2.0:1787380381.236426:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 166 00000100:00100000:2.0:1787380381.236436:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+40:12224:x1874203848552576:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:2.0:1787380381.236513:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69833 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.236529:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69833 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.236541:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69833 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.236574:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69833 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.236582:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69833 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.236588:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69833 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.236594:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0ee00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380381.236598:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69833 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.236605:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69833 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.236616:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:2.0:1787380381.236619:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787380381.236623:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69833 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.236628:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69833 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380381.236716:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+40:12224:x1874203848552576:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 282us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380381.236724:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 166 00000100:00100000:1.0:1787380381.239221:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380381.239266:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848552832 00000100:00100000:2.0:1787380381.239275:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848552832 00000100:00100000:2.0:1787380381.239329:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 41 00000100:00100000:2.0:1787380381.239339:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+40:12224:x1874203848552832:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1787380381.239595:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+41:12224:x1874203848552832:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 257us (393us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1787380381.239603:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 41 00000100:00100000:3.0:1787380381.559379:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380381.559510:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848553088 00000100:00100000:0.0:1787380381.559520:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848553088 00000100:00100000:0.0:1787380381.559693:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 167 00000100:00100000:0.0:1787380381.559703:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+41:12255:x1874203848553088:12345-192.168.206.30@tcp:101:cat.0 00010000:00010000:0.0:1787380381.559724:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380381.559741:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad6983a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae7f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.559866:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69841 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.559879:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69841 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.559888:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69841 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380381.559898:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787380381.559986:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad6983a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae7f expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.560004:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69841 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae7f expref: 43 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.560012:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:0.0:1787380381.560014:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380381.560017:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867c00, rc 0) 00000100:00100000:0.0:1787380381.560072:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+43:12255:x1874203848553088:12345-192.168.206.30@tcp:101:cat.0 Request processed in 371us (702us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787380381.560080:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 167 00000100:00100000:1.0:1787380381.563699:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380381.563739:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380381.563802:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848553344 00000100:00100000:0.0:1787380381.563855:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848553344 00000100:00100000:0.0:1787380381.563911:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00100000:0.0:1787380381.563920:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+43:12255:x1874203848553344:12345-192.168.206.30@tcp:35:cat.0 00000100:00100000:0.0:1787380381.564132:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+44:12255:x1874203848553344:12345-192.168.206.30@tcp:35:cat.0 Request processed in 212us (440us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1787380381.564140:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00100000:3.0:1787380381.564640:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848553472 00000100:00100000:3.0:1787380381.564646:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848553472 00000100:00100000:3.0:1787380381.564794:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:3.0:1787380381.564803:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+44:2398:x1874203848553472:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380381.564860:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380381.564881:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69841 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae7f expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380381.564898:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:3.0:1787380381.564902:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380381.564935:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+43:2398:x1874203848553472:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 134us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380381.564942:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:1.0:1787380381.602929:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380381.603029:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848553728 00000100:00100000:2.0:1787380381.603038:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848553728 00000100:00100000:2.0:1787380381.603126:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 168 00000100:00100000:2.0:1787380381.603135:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+43:12261:x1874203848553728:12345-192.168.206.30@tcp:101:dd.0 00010000:00010000:2.0:1787380381.603157:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380381.603160:0:10154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787380381.603184:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ea00/0xcf3c46fdcad697a7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae55 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.603200:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:2.0:1787380381.603204:0:10154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380381.603214:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad6984f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae86 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.603304:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69856 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.603331:0:10154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69825 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae78 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.603338:0:10154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69856 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.603368:0:10154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69825 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae78 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.603379:0:10154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69825 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae78 expref: 43 pid: 6523 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380381.603391:0:10154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d06300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10154:1874203867489280:192.168.206.30@tcp:104: 00000100:00100000:2.0:1787380381.603525:0:10154:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3de36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380381.606471:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380381.606691:0:10154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d06300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10154:1874203867489280:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380381.606717:0:10154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69856 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380381.607115:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848553856 00000100:00100000:0.0:1787380381.607123:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848553856 00010000:00010000:0.0:1787380381.607155:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69825 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae78 expref: 44 pid: 6523 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380381.607193:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 82 00000100:00100000:0.0:1787380381.607308:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd62b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+44:2400:x1874203848553856:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380381.607324:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380381.607330:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69825 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae78 expref: 44 pid: 6523 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.607342:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69825 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae78 expref: 44 pid: 6523 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.607361:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69825 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae78 expref: 44 pid: 6523 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.607375:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:0.0:1787380381.607379:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69856 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.607402:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69856 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.607409:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69856 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.607468:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380381.607514:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd62b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+43:2400:x1874203848553856:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 313us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380381.607522:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 82 00010000:00010000:2.0:1787380381.608087:0:10154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69856 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.608097:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69856 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380381.608116:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787380381.608238:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad6984f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae86 expref: 44 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.608267:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69856 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae86 expref: 43 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.608274:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:2.0:1787380381.608277:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787380381.608279:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0e200, rc 0) 00000100:00100000:2.0:1787380381.608312:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+43:12261:x1874203848553728:12345-192.168.206.30@tcp:101:dd.0 Request processed in 5178us (5392us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787380381.608319:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 168 00000100:00100000:1.0:1787380381.612099:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380381.612230:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848553984 00000100:00100000:2.0:1787380381.612240:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848553984 00000100:00100000:2.0:1787380381.612324:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 169 00000100:00100000:2.0:1787380381.612334:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+43:12261:x1874203848553984:12345-192.168.206.30@tcp:101:dd.0 00010000:00010000:2.0:1787380381.612355:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380381.612372:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad69864 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae8d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.612403:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad6986b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.612415:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad6986b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.612425:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad6986b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.612527:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad69864 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae8d expref: 45 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.612557:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad6986b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae8d expref: 44 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.612640:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:2.0:1787380381.612643:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787380381.612646:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0f600, rc 0) 00000100:00100000:2.0:1787380381.612700:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+44:12261:x1874203848553984:12345-192.168.206.30@tcp:101:dd.0 Request processed in 368us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380381.612706:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 169 00000100:00100000:3.0:1787380381.616638:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380381.616770:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848554240 00000100:00100000:1.0:1787380381.616779:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848554240 00000100:00100000:1.0:1787380381.616858:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 170 00000100:00100000:1.0:1787380381.616867:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+44:12261:x1874203848554240:12345-192.168.206.30@tcp:36:dd.0 00010000:00010000:1.0:1787380381.617079:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69872 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380381.617094:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69872 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380381.617104:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69872 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787380381.617145:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1787380381.617166:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ab547c95 reply state 00000000330b7ee9 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69872 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380381.617178:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69872 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380381.617185:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:1.0:1787380381.617188:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787380381.617191:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787380381.617279:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+47:12261:x1874203848554240:12345-192.168.206.30@tcp:36:dd.0 Request processed in 412us (647us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1787380381.617285:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 170 00000020:00080000:1.0:1787380381.617289:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787380381.773081:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787380381.837718:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787380381.837728:0:13800:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787380381.837878:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1787380381.837887:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787380381.884787:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380381.884976:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848554368 00000100:00100000:0.0:1787380381.884985:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848554368 00000100:00100000:0.0:1787380381.885090:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 171 00000100:00100000:0.0:1787380381.885101:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+47:12275:x1874203848554368:12345-192.168.206.30@tcp:101:stat.0 00010000:00010000:0.0:1787380381.885124:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380381.885142:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69879 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae94 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.885213:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69880 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.885239:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69880 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.885250:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69880 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.885262:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69887 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.885286:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69887 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.885293:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69887 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.885359:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6988e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.885370:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69856 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae86 expref: 48 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.885379:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6988e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.885415:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69856 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae86 expref: 48 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.885428:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69856 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae86 expref: 48 pid: 10154 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380381.885441:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f29f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874203867489408:192.168.206.30@tcp:104: 00000100:00100000:0.0:1787380381.885527:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec249f180 going to sleep for 11 seconds 00000100:00100000:2.0:1787380381.888456:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380381.889005:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f29f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874203867489408:192.168.206.30@tcp:104: 00010000:00010000:0.0:1787380381.889102:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6988e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380381.889194:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848554624 00000100:00100000:3.0:1787380381.889200:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848554624 00000100:00100000:3.0:1787380381.889361:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 43 00000100:00100000:3.0:1787380381.889371:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+49:6166:x1874203848554624:12345-192.168.206.30@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787380381.889941:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+50:6166:x1874203848554624:12345-192.168.206.30@tcp:35:ldlm_bl.0 Request processed in 569us (1490us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1787380381.889959:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 43 00000100:00100000:3.0:1787380381.894991:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380381.895912:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848554752 00000100:00100000:2.0:1787380381.895923:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848554752 00010000:00010000:2.0:1787380381.896095:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69856 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae86 expref: 50 pid: 10154 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380381.896186:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 83 00000100:00100000:2.0:1787380381.896197:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+50:2400:x1874203848554752:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380381.896212:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380381.896219:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69856 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae86 expref: 50 pid: 10154 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.896233:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69856 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae86 expref: 50 pid: 10154 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.896254:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69856 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae86 expref: 50 pid: 10154 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.896289:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:2.0:1787380381.896294:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6988e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.896304:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6988e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.896311:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6988e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.896342:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380381.896397:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+49:2400:x1874203848554752:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 202us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380381.896405:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 83 00010000:00010000:0.0:1787380381.896474:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6988e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.896488:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6988e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380381.896539:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787380381.896543:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787380381.896571:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6988e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.896583:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6988e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.896592:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69880 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.896599:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69880 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.896605:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69880 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.896611:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867c00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380381.896615:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69880 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.896622:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69880 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.896632:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:0.0:1787380381.896635:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380381.896638:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69880 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.896654:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69880 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.896888:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69887 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.896894:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69887 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.896900:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69887 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.896905:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380381.896908:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69887 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.896915:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69887 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.896923:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380381.896926:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380381.896928:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69887 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.896934:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69887 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.896978:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69879 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae94 expref: 49 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.896993:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6988e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae94 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380381.897006:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:0.0:1787380381.897009:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380381.897011:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866200, rc 0) 00000100:00100000:0.0:1787380381.897163:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+48:12275:x1874203848554368:12345-192.168.206.30@tcp:101:stat.0 Request processed in 12064us (12384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380381.897171:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 171 00000100:00100000:1.0:1787380381.948131:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380381.948224:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848555008 00000100:00100000:2.0:1787380381.948232:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848555008 00000100:00100000:2.0:1787380381.948287:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 172 00000100:00100000:2.0:1787380381.948296:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+48:12281:x1874203848555008:12345-192.168.206.30@tcp:36:truncate.0 00010000:00010000:2.0:1787380381.948346:0:10154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380381.948380:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6988e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae94 expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.948398:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:2.0:1787380381.948403:0:10154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380381.948551:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69895 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.948564:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69895 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.948586:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69895 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787380381.948627:0:10154:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1787380381.948649:0:10154:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ca4496c7 reply state 00000000226e56e5 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69895 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.948661:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69895 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380381.949043:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:2.0:1787380381.949046:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787380381.949048:0:10154:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787380381.949242:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+50:12281:x1874203848555008:12345-192.168.206.30@tcp:36:truncate.0 Request processed in 945us (1118us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1787380381.949250:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 172 00000020:00080000:2.0:1787380381.949255:0:10154:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787380382.114499:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380382.114642:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848555136 00000100:00100000:2.0:1787380382.114651:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848555136 00000100:00100000:2.0:1787380382.114798:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 173 00000100:00100000:2.0:1787380382.114845:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+50:12295:x1874203848555136:12345-192.168.206.30@tcp:101:stat.0 00010000:00010000:2.0:1787380382.114865:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380382.114882:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6989c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0ae9b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.114935:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698a3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.114949:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.114965:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.114976:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.114983:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.114989:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.115230:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad698b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.115240:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad698b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.115247:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad698b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380382.115283:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000100:00080000:0.0:1787380382.115285:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1787380382.115288:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787380382.115307:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad698b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.115318:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad698b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.115326:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.115341:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698a3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.115347:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.115353:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0ee00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380382.115358:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.115365:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.115376:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:2.0:1787380382.115379:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380382.115383:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.115390:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.115402:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.115408:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.115414:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.115419:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0f400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380382.115426:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.115432:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.119309:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6ec26f4500) 00010000:00010000:2.0:1787380382.119314:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380382.119321:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.119330:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.119379:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6989c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae9b expref: 52 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.119394:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad698b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae9b expref: 51 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.119402:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:2.0:1787380382.119404:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380382.119407:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0e000, rc 0) 00000100:00100000:2.0:1787380382.119567:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+51:12295:x1874203848555136:12345-192.168.206.30@tcp:101:stat.0 Request processed in 4759us (5074us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380382.119576:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 173 00000100:00100000:3.0:1787380382.204927:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380382.205098:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848555392 00000100:00100000:1.0:1787380382.205108:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848555392 00000100:00100000:1.0:1787380382.205175:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 174 00000100:00100000:1.0:1787380382.205185:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+51:12305:x1874203848555392:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1787380382.205212:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380382.205232:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad698b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0aea2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380382.205326:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787380382.205416:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad698b8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aea2 expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.205429:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec26f4200) 00010000:00010000:1.0:1787380382.205432:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787380382.205437:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad698b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aea2 expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.205450:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df1600, rc 0) 00000100:00100000:1.0:1787380382.205515:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+52:12305:x1874203848555392:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 331us (596us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1787380382.205522:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 174 00000100:00100000:1.0:1787380382.222691:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380382.222852:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848555648 00000100:00100000:2.0:1787380382.222862:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848555648 00000100:00100000:2.0:1787380382.222918:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 44 00000100:00100000:2.0:1787380382.222928:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7be3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+52:12305:x1874203848555648:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1787380382.223162:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7be3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+53:12305:x1874203848555648:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 235us (479us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1787380382.223171:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 44 00000100:00100000:3.0:1787380382.309180:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380382.312375:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848555904 00000100:00100000:0.0:1787380382.312390:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848555904 00000100:00100000:0.0:1787380382.312461:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 175 00000100:00100000:0.0:1787380382.312471:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+53:12311:x1874203848555904:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1787380382.312494:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380382.312513:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad698c6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0aea9 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.312633:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad698cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.312649:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad698b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae9b expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.312658:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad698cd lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.312688:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad698b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae9b expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.312720:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad698b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae9b expref: 54 pid: 6523 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380382.312733:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f29f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874203867489536:192.168.206.30@tcp:104: 00000100:00100000:0.0:1787380382.312845:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec249f180 going to sleep for 11 seconds 00000100:00100000:3.0:1787380382.319244:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380382.319378:0:10339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848556032 00000100:00100000:1.0:1787380382.319387:0:10339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848556032 00010000:00010000:1.0:1787380382.319423:0:10339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad698b1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae9b expref: 55 pid: 6523 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380382.319463:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 84 00000100:00100000:1.0:1787380382.319486:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+55:2399:x1874203848556032:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380382.319500:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380382.319506:0:10339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad698b1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae9b expref: 55 pid: 6523 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.319521:0:10339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad698b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae9b expref: 55 pid: 6523 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.319542:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:1.0:1787380382.319547:0:10339:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad698cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.319556:0:10339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad698cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.319563:0:10339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad698cd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.319578:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380382.320263:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e000/0xcf3c46fdcad698b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae9b expref: 55 pid: 6523 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380382.320283:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f29f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874203867489536:192.168.206.30@tcp:104: 00010000:00010000:0.0:1787380382.320302:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad698cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.320311:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad698cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.320316:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad698cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380382.320334:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787380382.320448:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad698c6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aea9 expref: 56 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.320464:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad698cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aea9 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.320472:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:0.0:1787380382.320483:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787380382.320486:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866600, rc 0) 00000100:00100000:0.0:1787380382.320578:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+55:12311:x1874203848555904:12345-192.168.206.30@tcp:101:bash.0 Request processed in 8107us (11405us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787380382.320586:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 175 00000100:00100000:1.0:1787380382.320771:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+54:2399:x1874203848556032:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 1286us (1539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380382.320778:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 84 00000100:00100000:1.0:1787380382.326333:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380382.326430:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848556288 00000100:00100000:2.0:1787380382.326439:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848556288 00000100:00100000:2.0:1787380382.326534:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 176 00000100:00100000:2.0:1787380382.326544:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+54:12311:x1874203848556288:12345-192.168.206.30@tcp:36:bash.0 00010000:00010000:2.0:1787380382.326767:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698db lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.326784:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.326795:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787380382.326876:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1787380382.326909:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000074f45878 reply state 00000000fe0301fa transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.326922:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.326930:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:2.0:1787380382.326933:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787380382.326935:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787380382.327031:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+57:12311:x1874203848556288:12345-192.168.206.30@tcp:36:bash.0 Request processed in 488us (705us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1787380382.327039:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 176 00000020:00080000:2.0:1787380382.327056:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787380382.337323:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380382.339374:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848556416 00000100:00100000:1.0:1787380382.339387:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848556416 00000100:00100000:1.0:1787380382.339460:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 177 00000100:00100000:1.0:1787380382.339470:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+57:12311:x1874203848556416:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:1.0:1787380382.339492:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380382.339524:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad698e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0aeb0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.339685:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad698e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.339701:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad698cd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aea9 expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.339710:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad698e9 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.339745:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad698cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aea9 expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.339759:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad698cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aea9 expref: 58 pid: 6521 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380382.339770:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c99500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867489664:192.168.206.30@tcp:104: 00000100:00100000:1.0:1787380382.339912:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956300 going to sleep for 11 seconds 00000100:00100000:0.0:1787380382.348918:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787380382.349018:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380382.349036:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867490048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380382.349117:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380382.349316:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380382.349327:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867489920:0@lo:400:kworker.0 00000100:00100000:3.0:1787380382.349357:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787380382.349408:0:9843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 392673597807ns, next at 393673595735ns, rc = 0 00000100:00100000:3.0:1787380382.349490:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867490176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380382.349513:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380382.349538:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867490048 00000100:00100000:3.0:1787380382.349543:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867490048 00000100:00100000:3.0:1787380382.349608:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867490176 00000100:00100000:3.0:1787380382.349612:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867490176 00000100:00100000:3.0:1787380382.349627:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787380382.349635:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867490048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787380382.349654:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380382.349690:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867490048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380382.349697:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787380382.349719:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787380382.349724:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1874203867490176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787380382.349731:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380382.349748:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1874203867490176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 25us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380382.349754:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1787380382.349769:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787380382.349799:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867490176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380382.349842:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867490048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380382.351483:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867489792:0@lo:400:kworker.0 00000100:00100000:0.0:1787380382.351544:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380382.351836:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380382.351841:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867489920 00000100:00100000:0.0:1787380382.351846:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867490304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380382.351847:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867489920 00000100:00100000:0.0:1787380382.351874:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380382.351885:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1787380382.351893:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867489920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380382.351948:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867489920:12345-0@lo:400:kworker.0 Request processed in 55us (2590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380382.351955:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1787380382.352054:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867490304 00000100:00100000:0.0:1787380382.352360:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867490304 00000100:00100000:0.0:1787380382.352393:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787380382.352400:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867490304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787380382.352425:0:13003:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1787380382.352461:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867490304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380382.352467:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787380382.352507:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867490304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380382.352548:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867489792 00000100:00100000:0.0:1787380382.352552:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867489792 00000100:00100000:0.0:1787380382.352784:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1787380382.352793:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3642:x1874203867489792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.353885:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867490560:0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.353936:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380382.354047:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867490560 00000100:00100000:1.0:1787380382.354053:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867490560 00000100:00100000:1.0:1787380382.354089:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787380382.354098:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867490560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.354144:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867490560:12345-0@lo:400:kworker.0 Request processed in 48us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380382.354162:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787380382.354197:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867490560:0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.354230:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380382.354250:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867490688:0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.354454:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380382.354506:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867491072:0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.354531:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380382.354558:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867491072 00000100:00100000:1.0:1787380382.354563:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867491072 00000100:00100000:1.0:1787380382.354595:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787380382.354602:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867491072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.354636:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867491072:12345-0@lo:400:kworker.0 Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380382.354642:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1787380382.354668:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867491072:0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.354699:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380382.354706:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867491200:0@lo:400:kworker.0 00000100:00100000:3.0:1787380382.354799:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867489920:0@lo:400:kworker.0 00000100:00100000:3.0:1787380382.354848:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1874203867490816:0@lo:400:kworker.0 00000100:00100000:3.0:1787380382.354885:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380382.354923:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787380382.354932:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867490432:0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.354940:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380382.354964:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380382.354988:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867490944:0@lo:400:kworker.0 00000100:00100000:3.0:1787380382.355008:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380382.355578:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787380382.355590:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867491328:0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.355620:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380382.355659:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867490688 00000100:00100000:1.0:1787380382.355665:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867490688 00000100:00100000:1.0:1787380382.355689:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867490816 00000100:00100000:1.0:1787380382.355691:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867490816 00000100:00100000:1.0:1787380382.355701:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867491200 00000100:00100000:1.0:1787380382.355712:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867491200 00000100:00100000:1.0:1787380382.355727:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867490432 00000100:00100000:1.0:1787380382.355729:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867490432 00000100:00100000:1.0:1787380382.356205:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867491328 00000100:00100000:1.0:1787380382.356210:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867491328 00000100:00100000:1.0:1787380382.356232:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1787380382.356250:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867490688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.356321:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867490688:12345-0@lo:400:kworker.0 Request processed in 81us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380382.356327:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1787380382.356361:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867490688:0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.356380:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1787380382.356387:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874203867490816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.356416:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874203867490816:12345-0@lo:400:kworker.0 Request processed in 30us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380382.356422:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1787380382.356433:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787380382.356439:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867491200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.356468:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867491200:12345-0@lo:400:kworker.0 Request processed in 30us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380382.356474:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1787380382.356494:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867491200:0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.356510:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787380382.356516:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867490432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.356542:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867490432:12345-0@lo:400:kworker.0 Request processed in 26us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380382.356557:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1787380382.356569:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1787380382.356575:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867491328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.356606:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867491328:12345-0@lo:400:kworker.0 Request processed in 31us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380382.356612:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00010000:00080000:1.0:1787380382.356635:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3f15880 x1874203867491328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380382.356645:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867491328:0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.356685:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867490944 00000100:00100000:1.0:1787380382.356688:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867490944 00000100:00100000:1.0:1787380382.356715:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787380382.356721:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867490944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.356752:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867490944:12345-0@lo:400:kworker.0 Request processed in 32us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380382.356759:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787380382.356846:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380382.356876:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c99500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867489664:192.168.206.30@tcp:104: 00010000:00010000:1.0:1787380382.356892:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad698e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380382.356921:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848556544 00000100:00100000:1.0:1787380382.356925:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848556544 00010000:00010000:1.0:1787380382.356943:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad698cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aea9 expref: 59 pid: 6521 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380382.356997:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 85 00000100:00100000:1.0:1787380382.357005:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:2400:x1874203848556544:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380382.357015:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380382.357022:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad698cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aea9 expref: 59 pid: 6521 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.357034:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad698cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aea9 expref: 59 pid: 6521 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.357054:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad698cd lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aea9 expref: 59 pid: 6521 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.357068:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:1.0:1787380382.357073:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad698e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.357082:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad698e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.357090:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad698e9 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.357109:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380382.357141:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+58:2400:x1874203848556544:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 137us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380382.357148:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 85 00010000:00010000:1.0:1787380382.357253:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad698e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.357266:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad698e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380382.357768:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787380382.357773:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787380382.357792:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad698e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.357856:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad698e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aeb0 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.357872:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad698e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aeb0 expref: 57 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.357879:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:1.0:1787380382.357882:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380382.357884:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df1c00, rc 0) 00000100:00100000:1.0:1787380382.357918:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+57:12311:x1874203848556416:12345-192.168.206.30@tcp:101:bash.0 Request processed in 18450us (20604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380382.357925:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 177 00000100:00100000:0.0:1787380382.358899:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3642:x1874203867489792:12345-0@lo:400:kworker.0 Request processed in 6104us (7351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380382.358923:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1787380382.358975:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867489792:0@lo:400:kworker.0 00000100:00080000:2.0:1787380382.360395:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787380382.360402:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380382.360406:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380382.360450:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867490432:0@lo:400:kworker.0 00000100:00100000:2.0:1787380382.360463:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867490944:0@lo:400:kworker.0 00010000:00080000:2.0:1787380382.360476:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3f14e00 x1874203867490816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380382.360486:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1874203867490816:0@lo:400:kworker.0 00000100:00100000:1.0:1787380382.367979:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380382.368051:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848556800 00000100:00100000:3.0:1787380382.368060:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848556800 00000100:00100000:3.0:1787380382.368115:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 45 00000100:00100000:3.0:1787380382.368125:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+57:12311:x1874203848556800:12345-192.168.206.30@tcp:35:bash.0 00000100:00100000:3.0:1787380382.368323:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+58:12311:x1874203848556800:12345-192.168.206.30@tcp:35:bash.0 Request processed in 198us (352us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787380382.368331:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 45 00000100:00100000:1.0:1787380382.504921:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380382.505372:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848557056 00000100:00100000:0.0:1787380382.505381:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848557056 00000100:00100000:0.0:1787380382.505439:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 178 00000100:00100000:0.0:1787380382.505449:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+58:12321:x1874203848557056:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1787380382.505470:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380382.505489:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad698f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0aeb7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380382.505585:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1787380382.505670:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad698f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aeb7 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.505683:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec26f4200) 00010000:00010000:0.0:1787380382.505687:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787380382.505691:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad698f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aeb7 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.505705:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867800, rc 0) 00000100:00100000:0.0:1787380382.505768:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:12321:x1874203848557056:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 320us (855us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1787380382.505775:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 178 00000100:00100000:1.0:1787380382.513460:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380382.513842:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848557184 00000100:00100000:2.0:1787380382.513851:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848557184 00000100:00100000:2.0:1787380382.513911:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 179 00000100:00100000:2.0:1787380382.513921:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:12321:x1874203848557184:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:2.0:1787380382.514000:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698fe lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514015:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514027:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514037:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad69905 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514074:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad69905 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514083:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad69905 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514152:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6990c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514161:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6990c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514169:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6990c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380382.514224:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6990c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514236:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514242:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698fe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514248:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514254:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0ee00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380382.514257:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514264:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698fe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514283:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:2.0:1787380382.514286:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380382.514290:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514296:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ee00/0xcf3c46fdcad698fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514310:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad69905 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514315:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad69905 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514320:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad69905 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514325:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0e600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380382.514327:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad69905 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514333:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad69905 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514340:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6ec26f4500) 00010000:00010000:2.0:1787380382.514342:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380382.514345:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad69905 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514350:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e600/0xcf3c46fdcad69905 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514368:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6990c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514374:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6990c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514379:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6990c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514383:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0fc00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380382.514386:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6990c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514391:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6990c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514398:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:2.0:1787380382.514400:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380382.514402:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6990c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380382.514407:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fc00/0xcf3c46fdcad6990c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380382.514478:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:12321:x1874203848557184:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 558us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380382.514487:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 179 00000100:00100000:3.0:1787380382.526936:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380382.527080:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848557440 00000100:00100000:0.0:1787380382.527089:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848557440 00000100:00100000:0.0:1787380382.527144:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 46 00000100:00100000:0.0:1787380382.527167:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:12321:x1874203848557440:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:0.0:1787380382.527382:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:12321:x1874203848557440:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 217us (458us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1787380382.527390:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 46 00000100:00100000:1.0:1787380382.615260:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380382.615360:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848557696 00000100:00100000:0.0:1787380382.615370:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848557696 00000100:00100000:0.0:1787380382.615431:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 180 00000100:00100000:0.0:1787380382.615442:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:12324:x1874203848557696:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1787380382.615463:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380382.615482:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69913 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0aebe expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.615550:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6991a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.615583:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6991a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.615602:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6991a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.615622:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69921 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.615629:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69921 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.615637:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69921 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.615755:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69928 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.615766:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69928 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.615773:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69928 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380382.615783:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787380382.615923:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6991a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.615932:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6991a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.615939:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6991a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.615945:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867c00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380382.615950:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6991a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.615958:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6991a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.615969:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:0.0:1787380382.615972:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380382.615977:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6991a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.615994:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad6991a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.616009:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69921 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.616016:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69921 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.616022:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69921 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.616027:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380382.616030:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69921 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.616036:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69921 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.616045:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380382.616047:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380382.616050:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69921 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.616055:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69921 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.616089:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69913 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aebe expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.616102:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69928 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aebe expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.616114:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:0.0:1787380382.616116:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380382.616119:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867a00, rc 0) 00000100:00100000:0.0:1787380382.616184:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+62:12324:x1874203848557696:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 744us (934us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787380382.616192:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 180 00000100:00100000:1.0:1787380382.620336:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380382.620379:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380382.620447:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848557824 00000100:00100000:3.0:1787380382.620457:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848557824 00000100:00100000:3.0:1787380382.620517:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:3.0:1787380382.620528:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+62:2400:x1874203848557824:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380382.620542:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380382.620590:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69928 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aebe expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380382.620720:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:3.0:1787380382.620726:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380382.620752:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848557952 00000100:00100000:2.0:1787380382.620756:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848557952 00000100:00100000:3.0:1787380382.620787:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+62:2400:x1874203848557824:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 261us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380382.620787:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 181 00000100:00100000:3.0:1787380382.620836:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:2.0:1787380382.620836:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+62:12324:x1874203848557952:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:3.0:1787380382.621260:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69936 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380382.621275:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69936 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380382.621285:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69936 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380382.621318:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69936 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380382.621325:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69936 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380382.621331:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69936 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380382.621336:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380382.621340:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69936 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380382.621346:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69936 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380382.621355:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:3.0:1787380382.621357:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380382.621360:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69936 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380382.621365:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69936 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380382.621425:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+61:12324:x1874203848557952:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 619us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380382.621432:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 181 00000100:00100000:1.0:1787380382.632198:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380382.632294:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848558208 00000100:00100000:2.0:1787380382.632302:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848558208 00000100:00100000:2.0:1787380382.632359:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 47 00000100:00100000:2.0:1787380382.632368:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+61:12324:x1874203848558208:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1787380382.632577:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+62:12324:x1874203848558208:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 204us (380us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787380382.632591:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 47 00010000:00010000:3.0:1787380382.796690:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380382.860111:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867491456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787380382.860188:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380382.860354:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867491456 00000100:00100000:3.0:1787380382.860362:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867491456 00000100:00100000:3.0:1787380382.860412:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787380382.860420:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867491456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787380382.860446:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1787380382.860642:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380382.860651:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867491584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380382.860680:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380382.860752:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867491584 00000100:00100000:0.0:1787380382.860757:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867491584 00000100:00100000:0.0:1787380382.860779:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787380382.860786:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3fedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867491584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380382.860797:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1787380382.860876:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3fedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867491584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380382.860883:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787380382.860974:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867491456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 554us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380382.860981:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787380382.861723:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867491584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380382.863215:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867491456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787380382.881297:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380382.881420:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848558464 00000100:00100000:0.0:1787380382.881430:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848558464 00000100:00100000:0.0:1787380382.881490:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 182 00000100:00100000:0.0:1787380382.881500:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+62:12342:x1874203848558464:12345-192.168.206.30@tcp:101:cat.0 00010000:00010000:0.0:1787380382.881523:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380382.881542:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad6993d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0aec5 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.881649:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69944 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.881662:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69944 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.881688:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69944 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380382.881701:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787380382.881843:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad6993d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aec5 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.881863:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69944 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aec5 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.881872:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:0.0:1787380382.881875:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787380382.881879:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867000, rc 0) 00000100:00100000:0.0:1787380382.881944:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+64:12342:x1874203848558464:12345-192.168.206.30@tcp:101:cat.0 Request processed in 445us (656us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1787380382.881953:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 182 00000100:00100000:1.0:1787380382.888467:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380382.888504:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380382.888537:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380382.888566:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380382.888584:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380382.888644:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380382.888674:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848558848 00000100:00100000:1.0:1787380382.888683:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848558848 00000100:00100000:1.0:1787380382.888736:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848558976 00000100:00100000:1.0:1787380382.888740:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848558976 00000100:00100000:1.0:1787380382.888764:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 121 00000100:00100000:1.0:1787380382.888775:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2398:x1874203848558848:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380382.888892:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2398:x1874203848558848:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 118us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380382.888900:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 121 00000100:00100000:1.0:1787380382.888915:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 122 00000100:00100000:1.0:1787380382.888921:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2398:x1874203848558976:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380382.888943:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2398:x1874203848558976:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 22us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380382.888948:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 122 00000100:00080000:1.0:1787380382.888962:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787380382.888965:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380382.889329:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848559104 00000100:00100000:3.0:1787380382.889333:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848559104 00000100:00100000:3.0:1787380382.889377:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848558720 00000100:00100000:3.0:1787380382.889380:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848558720 00000100:00100000:3.0:1787380382.889392:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848559232 00000100:00100000:3.0:1787380382.889395:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848559232 00000100:00100000:3.0:1787380382.889409:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 316 00000100:00100000:3.0:1787380382.889415:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848559104:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380382.889450:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848559104:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 36us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380382.889457:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 316 00000100:00100000:3.0:1787380382.889475:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 317 00000100:00100000:3.0:1787380382.889481:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848558720:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380382.889503:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848558720:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 22us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380382.889517:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 317 00000100:00100000:3.0:1787380382.889530:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 318 00000100:00100000:3.0:1787380382.889536:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848559232:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380382.889572:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848559232:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 36us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380382.889577:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 318 00000100:00080000:1.0:1787380382.890072:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787380382.890076:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380382.896274:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848558592 00000100:00100000:2.0:1787380382.896299:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848558592 00000100:00100000:2.0:1787380382.896372:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 386 00000100:00100000:2.0:1787380382.896382:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2398:x1874203848558592:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380382.896460:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2398:x1874203848558592:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 79us (8001us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380382.896468:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 386 00000100:00100000:1.0:1787380382.932462:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380382.932754:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848559360 00000100:00100000:3.0:1787380382.932764:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848559360 00000100:00100000:3.0:1787380382.932877:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 183 00000100:00100000:3.0:1787380382.932887:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+64:12343:x1874203848559360:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1787380382.932909:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380382.932927:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69952 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0aecc expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380382.932988:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69959 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380382.933002:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69959 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380382.933013:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69959 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380382.933054:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787380382.933058:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787380382.933075:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69959 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380382.933120:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69952 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aecc expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380382.933139:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69959 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aecc expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380382.933148:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:3.0:1787380382.933151:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787380382.933155:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89c400, rc 0) 00000100:00100000:3.0:1787380382.933227:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+65:12343:x1874203848559360:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 342us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380382.933235:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 183 00000100:00100000:3.0:1787380382.937174:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380382.938372:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848559744 00000100:00100000:2.0:1787380382.938383:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848559744 00000100:00100000:2.0:1787380382.938442:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 48 00000100:00100000:2.0:1787380382.938453:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+65:12343:x1874203848559744:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1787380382.938715:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+66:12343:x1874203848559744:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 263us (1548us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1787380382.938735:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 48 00000100:00100000:2.0:1787380382.945507:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380382.945768:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848559872 00000100:00100000:1.0:1787380382.945778:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848559872 00000100:00100000:1.0:1787380382.945883:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:1.0:1787380382.945896:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+66:12343:x1874203848559872:12345-192.168.206.30@tcp:103:lfs.0 00010000:00010000:1.0:1787380382.945912:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787380382.945936:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad698e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aeb0 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.945958:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69944 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aec5 expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.945972:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0fa00/0xcf3c46fdcad697e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae6a expref: 64 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380382.945982:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:1.0:1787380382.945986:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380382.946042:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+63:12343:x1874203848559872:12345-192.168.206.30@tcp:103:lfs.0 Request processed in 149us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380382.946049:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:1.0:1787380382.949149:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380382.949286:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848560000 00000100:00100000:3.0:1787380382.949295:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848560000 00000100:00100000:3.0:1787380382.949348:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 184 00000100:00100000:3.0:1787380382.949357:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+63:12343:x1874203848560000:12345-192.168.206.30@tcp:58:lfs.0 00010000:00010000:3.0:1787380382.949456:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69960 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380382.949473:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69960 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380382.949485:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69960 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787380382.949599:0:10154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787380382.950157:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+63:12343:x1874203848560000:12345-192.168.206.30@tcp:58:lfs.0 Request processed in 798us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380382.950177:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 184 00000100:00100000:3.0:1787380382.981162:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380382.981274:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848560128 00000100:00100000:0.0:1787380382.981283:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848560128 00000100:00100000:0.0:1787380382.981343:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 185 00000100:00100000:0.0:1787380382.981353:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+63:12345:x1874203848560128:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1787380382.981373:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380382.981391:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69967 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0aed3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.981453:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6996e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.981483:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6996e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.981493:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6996e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.981506:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69975 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.981512:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69975 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.981519:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69975 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.981866:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6997c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.981878:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6997c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.981886:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6997c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380382.981927:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787380382.981932:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787380382.981950:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6997c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.981961:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6997c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.981980:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6996e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.981985:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6996e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.981991:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6996e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.981996:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380382.982000:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6996e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.982006:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6996e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.982018:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:0.0:1787380382.982021:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380382.982025:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6996e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.982031:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad6996e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.982044:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69975 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.982049:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69975 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.982054:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69975 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.982066:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380382.982069:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69975 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.982075:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69975 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.982083:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380382.982086:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380382.982089:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69975 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.982094:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69975 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.982121:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69967 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aed3 expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.982133:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6997c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aed3 expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380382.982141:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:0.0:1787380382.982144:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787380382.982146:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867000, rc 0) 00000100:00100000:0.0:1787380382.982212:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+64:12345:x1874203848560128:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 859us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380382.982220:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 185 00000040:00080000:3.0:1787380383.743001:0:14662:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787380383.743009:0:14662:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787380383.743031:0:14662:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787380383.743038:0:14662:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787380383.823149:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380383.887402:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380383.887423:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867491712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787380383.887484:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380383.887543:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867491712 00000100:00100000:1.0:1787380383.887562:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867491712 00000100:00100000:1.0:1787380383.887617:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787380383.887626:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867491712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380383.887668:0:6526:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380383.887709:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867491712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380383.887717:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787380383.887762:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f9bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867491712:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1787380383.888855:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787380383.888861:0:13800:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787380383.888903:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787380383.888910:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787380383.889016:0:13800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f9bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1874203867491840:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787380383.889077:0:13800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956180 going to sleep for 11 seconds 00000100:00100000:1.0:1787380383.897880:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380383.898005:0:13800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f9bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1874203867491840:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787380383.898163:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848560256 00000100:00100000:2.0:1787380383.898170:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848560256 00000100:00100000:2.0:1787380383.898227:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 186 00000100:00100000:2.0:1787380383.898236:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+64:12358:x1874203848560256:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787380383.898264:0:6521:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787380383.898354:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+64:12358:x1874203848560256:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 119us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380383.898362:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 186 00000001:00080000:1.0:1787380383.906301:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:1.0:1787380383.906325:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1787380383.906368:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787380383.906376:0:6500:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d6ec3378c00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787380383.906382:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ec3eaaa00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d6ec3378900 00000020:00080000:1.0:1787380383.906386:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ec3eaa300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d6ec44dba00 00000020:00080000:2.0:1787380383.906607:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1787380383.906660:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1787380383.906670:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787380383.906689:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec336ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867491968:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787380383.906750:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380383.906790:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867491968 00000100:00100000:2.0:1787380383.906832:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867491968 00000100:00100000:2.0:1787380383.906879:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787380383.906887:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1874203867491968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787380383.906911:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:2.0:1787380383.906941:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a89429d, atime: 0x0, ctime: 0x6a89429d, blocks: 0x8 00010000:00010000:2.0:1787380383.906950:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df2a5570/0xcf3c46fdcad69983 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380383.906965:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=394s v=(0 0) 00010000:00010000:2.0:1787380383.906980:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380383.906987:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df2a5570/0xcf3c46fdcad69983 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380383.907003:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df2a5570/0xcf3c46fdcad69983 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380383.907012:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df2a5570/0xcf3c46fdcad69983 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380383.907020:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df2a5570/0xcf3c46fdcad69983 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380383.907037:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787380383.907152:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3642:x1874203867491968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 265us (400us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787380383.907159:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:2.0:1787380383.907180:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380383.907199:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df2a5570/0xcf3c46fdcad69983 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380383.907207:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0f200 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380383.907211:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df2a5570/0xcf3c46fdcad69983 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380383.907220:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df2a5570/0xcf3c46fdcad69983 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380383.907247:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df2a5570/0xcf3c46fdcad69983 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380383.907254:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df2a5570/0xcf3c46fdcad69983 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380383.907272:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380383.907274:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380383.907276:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787380383.907304:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6ec336ea00/2, rc 0, transno 4294967308 00000100:00100000:2.0:1787380383.907310:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec336ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867491968:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787380383.907490:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0800/0xcf3c46fdcad69729 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907499:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0800/0xcf3c46fdcad69729 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907505:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0800/0xcf3c46fdcad69729 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907510:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df0800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380383.907513:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0800/0xcf3c46fdcad69729 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907519:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0800/0xcf3c46fdcad69729 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907530:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9d6ec3030f00) 00010000:00010000:0.0:1787380383.907533:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380383.907536:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0800/0xcf3c46fdcad69729 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907543:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0800/0xcf3c46fdcad69729 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907559:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1800/0xcf3c46fdcad69730 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907565:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1800/0xcf3c46fdcad69730 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907570:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1800/0xcf3c46fdcad69730 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907586:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380383.907589:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1800/0xcf3c46fdcad69730 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907606:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1800/0xcf3c46fdcad69730 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907615:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:0.0:1787380383.907617:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380383.907620:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1800/0xcf3c46fdcad69730 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907626:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1800/0xcf3c46fdcad69730 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907641:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6976f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907647:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6976f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907653:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6976f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907659:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380383.907662:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6976f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907667:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6976f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907686:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380383.907689:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380383.907692:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6976f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907697:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6976f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907714:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69872 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907721:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69872 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907727:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69872 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907732:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1e00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380383.907734:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69872 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907739:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69872 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907746:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:0.0:1787380383.907748:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380383.907751:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69872 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907756:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69872 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907778:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69895 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907783:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69895 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907789:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69895 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907794:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0e200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380383.907831:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69895 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907838:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69895 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907847:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:0.0:1787380383.907849:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380383.907852:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69895 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907859:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e200/0xcf3c46fdcad69895 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907870:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907875:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698db lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907881:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907891:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0f400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380383.907894:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907899:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698db lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907907:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:0.0:1787380383.907915:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380383.907918:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698db lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.907923:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f400/0xcf3c46fdcad698db lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380383.921349:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380383.921438:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848560384 00000100:00100000:3.0:1787380383.921448:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848560384 00000100:00100000:3.0:1787380383.921505:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 187 00000100:00100000:3.0:1787380383.921515:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+17:12358:x1874203848560384:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787380383.921595:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad6998a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921613:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad6998a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921624:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad6998a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921639:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69991 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921646:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69991 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921653:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69991 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921679:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69998 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921700:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69998 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921707:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69998 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380383.921749:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787380383.921753:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787380383.921766:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69998 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921777:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad6998a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921783:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad6998a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921789:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad6998a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921806:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89ce00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380383.921834:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad6998a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921842:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad6998a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921853:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6ec25a8300) 00010000:00010000:3.0:1787380383.921856:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380383.921859:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad6998a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921876:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad6998a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921891:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69991 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921897:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69991 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921903:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69991 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921907:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380383.921910:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69991 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921916:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69991 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921924:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9d6ec241a800) 00010000:00010000:3.0:1787380383.921926:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380383.921929:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69991 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921934:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69991 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921957:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69998 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921962:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69998 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921973:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69998 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921977:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89de00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380383.921980:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69998 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921986:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69998 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.921993:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:3.0:1787380383.921996:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380383.921998:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69998 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.922003:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69998 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380383.922070:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+17:12358:x1874203848560384:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 Request processed in 555us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380383.922078:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 187 00000100:00100000:1.0:1787380383.926761:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380383.926854:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848560640 00000100:00100000:0.0:1787380383.926863:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848560640 00000100:00100000:0.0:1787380383.926912:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 188 00000100:00100000:0.0:1787380383.926921:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+17:12358:x1874203848560640:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380383.926939:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380383.926956:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6999f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0aeda expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.927047:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad699a6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.927061:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad699a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.927088:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad699a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380383.927099:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787380383.927174:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad699a6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.927182:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad699a6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.927189:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad699a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.927297:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380383.927302:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad699a6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.927309:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad699a6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.927322:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:0.0:1787380383.927325:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787380383.927329:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad699a6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.927335:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad699a6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.927373:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6999f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aeda expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.927395:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6ec25a8300) 00010000:00010000:0.0:1787380383.927398:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787380383.927403:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6999f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aeda expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380383.927412:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866a00, rc 0) 00000100:00100000:0.0:1787380383.927556:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:12358:x1874203848560640:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 626us (792us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1787380383.927564:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 188 00000100:00100000:0.0:1787380383.936788:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380383.937168:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848560768 00000100:00100000:3.0:1787380383.937177:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848560768 00000100:00100000:3.0:1787380383.937242:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 189 00000100:00100000:3.0:1787380383.937252:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:12358:x1874203848560768:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787380383.937285:0:6523:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787380383.937424:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:12358:x1874203848560768:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 173us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380383.937444:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 189 00000100:00100000:1.0:1787380383.949241:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380383.949780:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848561024 00000100:00100000:3.0:1787380383.949791:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848561024 00000100:00100000:3.0:1787380383.949890:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 190 00000100:00100000:3.0:1787380383.949901:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:12358:x1874203848561024:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380383.949921:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380383.949924:0:10154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787380383.949947:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69959 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aecc expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.949965:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:3.0:1787380383.949970:0:10154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380383.949982:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad699b4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0aee1 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787380383.950325:0:10154:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787380383.950454:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad699bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.950468:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad699bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.950477:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad699bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.950525:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad699b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aee1 expref: 20 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.950570:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad699bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aee1 expref: 19 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.950578:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d6ec241a800) 00010000:00010000:3.0:1787380383.950580:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380383.950582:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89d800, rc 0) 00000100:00100000:3.0:1787380383.950637:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:12358:x1874203848561024:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 738us (1402us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787380383.950645:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 190 00000100:00100000:2.0:1787380383.961690:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380383.962566:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848561280 00000100:00100000:3.0:1787380383.962578:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848561280 00000100:00100000:3.0:1787380383.962648:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 191 00000100:00100000:3.0:1787380383.962658:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:12358:x1874203848561280:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787380383.962713:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380383.962738:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad699bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aee1 expref: 19 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.962756:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d6ec241a800) 00010000:00010000:3.0:1787380383.962775:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380383.962794:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad699c9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.962847:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad699c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.962857:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad699c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.962885:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x6c60528 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.962893:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6c60528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.962900:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6c60528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.962943:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad699c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.962951:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad699c9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.962958:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad699c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.962964:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89ce00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380383.962969:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad699c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.962976:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad699c9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.962983:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:3.0:1787380383.962986:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380383.962989:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad699c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.962994:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad699c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.963011:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6c60528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.963018:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699d0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6c60528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.963024:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6c60528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.963029:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380383.963032:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6c60528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.963038:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699d0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6c60528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.963045:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x6c60528 (ffff9d6ec241aa00) 00010000:00010000:3.0:1787380383.963047:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380383.963050:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699d0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6c60528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.963054:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699d0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6c60528 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380383.963127:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:12358:x1874203848561280:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 471us (1445us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787380383.963134:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 191 00000100:00100000:1.0:1787380383.966951:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380383.967274:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848561408 00000100:00100000:3.0:1787380383.967283:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848561408 00000100:00100000:3.0:1787380383.967338:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 192 00000100:00100000:3.0:1787380383.967359:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:12358:x1874203848561408:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380383.967379:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380383.967400:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad699d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0aee8 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.967439:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad699de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.967451:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad699de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.967462:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad699de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.967572:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad699d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aee8 expref: 20 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.967589:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad699de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aee8 expref: 19 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.967597:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d6ec241a400) 00010000:00010000:3.0:1787380383.967599:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787380383.967603:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89ca00, rc 0) 00000100:00100000:3.0:1787380383.967706:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:12358:x1874203848561408:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 349us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380383.967715:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 192 00000100:00100000:3.0:1787380383.983635:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380383.983678:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848561664 00000100:00100000:3.0:1787380383.983697:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848561664 00000100:00100000:3.0:1787380383.983760:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 193 00000100:00100000:3.0:1787380383.983769:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:12358:x1874203848561664:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787380383.983875:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad699e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.983893:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad699e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.983905:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad699e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787380383.984060:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1787380383.984069:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 394308259315ns, next at 395308257386ns, rc = 0 00000004:00010000:3.0:1787380383.984116:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f5c6972 reply state 00000000d30b9177 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad699e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.984128:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad699e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.984135:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d6ec241a400) 00010000:00010000:3.0:1787380383.984138:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787380383.984141:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380383.984237:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+21:12358:x1874203848561664:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 467us (609us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787380383.984244:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 193 00000100:00100000:1.0:1787380383.987110:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380383.987170:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848561792 00000100:00100000:3.0:1787380383.987179:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848561792 00000100:00100000:3.0:1787380383.987296:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 194 00000100:00100000:3.0:1787380383.987306:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+21:12358:x1874203848561792:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380383.987339:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380383.987357:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0aeef expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.987403:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aeef expref: 22 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.987416:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aeef expref: 22 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380383.987433:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d6ec241a400) 00010000:00010000:3.0:1787380383.987436:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787380383.987439:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89c200, rc 0) 00000100:00100000:3.0:1787380383.987494:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:12358:x1874203848561792:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 190us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380383.987501:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 194 00000100:00100000:3.0:1787380383.989777:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380383.989973:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848561920 00000100:00100000:0.0:1787380383.989981:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848561920 00000100:00100000:0.0:1787380383.990034:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 60 00000100:00100000:0.0:1787380383.990044:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2399:x1874203848561920:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787380383.990254:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2399:x1874203848561920:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 211us (483us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787380383.990262:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 60 00000100:00100000:0.0:1787380383.992230:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380383.992398:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848562176 00000100:00100000:3.0:1787380383.992407:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848562176 00000100:00100000:3.0:1787380383.992463:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 49 00000100:00100000:3.0:1787380383.992473:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:12358:x1874203848562176:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787380383.992719:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+23:12358:x1874203848562176:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 247us (496us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1787380383.992727:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 49 00000100:00100000:1.0:1787380384.005002:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380384.005084:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848562432 00000100:00100000:3.0:1787380384.005093:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848562432 00000100:00100000:3.0:1787380384.005164:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 195 00000100:00100000:3.0:1787380384.005174:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+23:12358:x1874203848562432:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787380384.005283:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+23:12358:x1874203848562432:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 110us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380384.005291:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 195 00000100:00080000:1.0:1787380384.006281:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380384.008386:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380384.008498:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848562560 00000100:00100000:0.0:1787380384.008507:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848562560 00000100:00100000:0.0:1787380384.008571:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 196 00000100:00100000:0.0:1787380384.008581:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+23:12358:x1874203848562560:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380384.008599:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380384.008618:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad699f3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0aef6 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.008695:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad699fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.008710:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad699fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.008721:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad699fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380384.008765:0:10154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787380384.008783:0:10154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad699fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.008850:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad699f3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aef6 expref: 25 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.008867:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad699fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aef6 expref: 24 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.008877:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d6ec241a400) 00010000:00010000:0.0:1787380384.008879:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787380384.008883:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866600, rc 0) 00000100:00100000:0.0:1787380384.008938:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+24:12358:x1874203848562560:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 358us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380384.008946:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 196 00000100:00100000:3.0:1787380384.011546:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380384.011686:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848562688 00000100:00100000:0.0:1787380384.011696:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848562688 00000100:00100000:0.0:1787380384.011768:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 61 00000100:00100000:0.0:1787380384.011791:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2400:x1874203848562688:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380384.011838:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380384.011857:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad69a01 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0aefd expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380384.011882:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8942a0, blocks: 0x0 00010000:00010000:0.0:1787380384.011900:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=394s v=(0 0) 00010000:00010000:0.0:1787380384.011905:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380384.011913:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad69a01 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aefd expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.011930:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad69a01 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aefd expref: 8 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.011943:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866200, rc 0) 00000100:00100000:0.0:1787380384.011991:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2400:x1874203848562688:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 203us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380384.011999:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 61 00000100:00080000:2.0:1787380384.012425:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380384.016933:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380384.016999:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848562944 00000100:00100000:3.0:1787380384.017008:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848562944 00000100:00100000:3.0:1787380384.017066:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 197 00000100:00100000:3.0:1787380384.017076:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+24:12358:x1874203848562944:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787380384.017169:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+24:12358:x1874203848562944:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 94us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380384.017177:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 197 00000100:00100000:2.0:1787380384.028789:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380384.031035:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848563072 00000100:00100000:3.0:1787380384.031049:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848563072 00000100:00100000:3.0:1787380384.036372:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 62 00000100:00100000:3.0:1787380384.036390:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:12358:x1874203848563072:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380384.036408:0:8871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380384.036425:0:8871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad69a08 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af04 expref: -99 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.036454:0:8871:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad69a01 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aefd expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.036461:0:8871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380384.036472:0:8871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380384.036478:0:8871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad69a08 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af04 expref: 9 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.036511:0:8871:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad69a01 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aefd expref: 9 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.036524:0:8871:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad69a01 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aefd expref: 9 pid: 8436 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380384.036537:0:8871:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8871:1874203867492096:192.168.206.30@tcp:104: 00000100:00100000:3.0:1787380384.036636:0:8871:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3de3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787380384.046010:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380384.046041:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848563200 00000100:00100000:1.0:1787380384.046057:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848563200 00010000:00010000:1.0:1787380384.046090:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad69a01 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aefd expref: 10 pid: 8436 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380384.046125:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 86 00000100:00100000:1.0:1787380384.046134:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+10:2399:x1874203848563200:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380384.046147:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380384.046166:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad69a01 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aefd expref: 10 pid: 8436 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.046179:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad69a01 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aefd expref: 10 pid: 8436 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.046217:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380384.046222:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380384.046231:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad69a08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af04 expref: 10 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.046240:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad69a08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af04 expref: 10 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.046271:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad69a08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af04 expref: 10 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380384.046284:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f99880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6508:1874203867492224:192.168.206.30@tcp:105: 00000100:00100000:1.0:1787380384.046350:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956180 going to sleep for 11 seconds 00010000:00010000:3.0:1787380384.053262:0:8871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3d8cf4b/0xcf3c46fdcad69a01 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aefd expref: 10 pid: 8436 timeout: 494 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380384.053284:0:8871:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8871:1874203867492096:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380384.053310:0:8871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad69a08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af04 expref: 9 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.053324:0:8871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89d400, rc 0) 00000100:00100000:2.0:1787380384.053757:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f99880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6508:1874203867492224:192.168.206.30@tcp:105: 00010000:00010000:2.0:1787380384.053770:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380384.053833:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:2399:x1874203848563200:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 7699us (7829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380384.053843:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 86 00000100:00100000:3.0:1787380384.056284:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:12358:x1874203848563072:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 19891us (27491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380384.056296:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 62 00000100:00100000:2.0:1787380384.063328:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380384.063438:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848563328 00000100:00100000:2.0:1787380384.063446:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848563328 00002000:00100000:2.0:1787380384.063494:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9d6ec3d79c00 x1874203848563328/t0(0) o4->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:190/0 lens 504/0 e 0 to 0 dl 1787380395 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787380384.063504:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec3d79c00 with x1874203848563328 ext(0->8) 00002000:00010000:2.0:1787380384.063523:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d6ec3d79c00 00000100:00100000:2.0:1787380384.063657:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:2.0:1787380384.063667:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2400:x1874203848563328:12345-192.168.206.30@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787380384.064848:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+10:2400:x1874203848563328:12345-192.168.206.30@tcp:4:lhsmtool_posix.0 Request processed in 1177us (1523us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787380384.064860:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 5 00002000:00100000:2.0:1787380384.064868:0:8439:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9d6ec3d79c00 x1874203848563328/t4294967315(0) o4->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:190/0 lens 504/448 e 0 to 0 dl 1787380395 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787380384.064877:0:8439:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec3d79c00 with x1874203848563328 ext(0->8) 00002000:00010000:2.0:1787380384.064882:0:8439:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d6ec3d79c00 00000100:00100000:2.0:1787380384.070789:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380384.071373:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848563456 00000100:00100000:1.0:1787380384.071383:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848563456 00000100:00100000:1.0:1787380384.071440:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 198 00000100:00100000:1.0:1787380384.071450:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+24:12358:x1874203848563456:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787380384.074733:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1787380384.074751:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1787380384.074772:0:6500:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1787380384.074793:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1787380384.074838:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:1.0:1787380384.074896:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad699e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.074909:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad699e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.074916:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad699e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.074921:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89de00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380384.074925:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad699e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.074933:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad699e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.074948:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d6ec241a400) 00010000:00010000:1.0:1787380384.074951:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787380384.074955:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad699e5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.074961:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad699e5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380384.075087:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:12358:x1874203848563456:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 Request processed in 3636us (4304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380384.075097:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 198 00000100:00100000:1.0:1787380384.075338:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867492352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787380384.075397:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380384.077149:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867492352 00000100:00100000:0.0:1787380384.077162:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867492352 00000100:00100000:0.0:1787380384.077280:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787380384.077290:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867492352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787380384.077400:0:12152:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787380384.077403:0:12152:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787380384 00002000:00010000:0.0:1787380384.077405:0:12152:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787380384.077418:0:12152:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787380384 -> 1787380384 00002000:00010000:0.0:1787380384.077420:0:12152:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1787380384.077481:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3642:x1874203867492352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 193us (2084us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787380384.077488:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1787380384.077530:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380384.077962:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380384.078278:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848563584 00000100:00100000:1.0:1787380384.078283:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848563584 00000100:00100000:1.0:1787380384.078324:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 64 00000100:00100000:1.0:1787380384.078331:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+10:2399:x1874203848563584:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1787380384.079264:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6fc3b64380/2, rc 0, transno 4294967316 00000100:00100000:1.0:1787380384.079273:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867492352:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1787380384.079838:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1787380384.079848:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1787380384.079978:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2399:x1874203848563584:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 Request processed in 1644us (2015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380384.079987:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 64 00000100:00100000:0.0:1787380384.082372:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380384.082443:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848563840 00000100:00100000:3.0:1787380384.082461:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848563840 00000100:00100000:3.0:1787380384.082515:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 199 00000100:00100000:3.0:1787380384.082538:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:12358:x1874203848563840:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787380384.082598:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380384.082624:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad699fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aef6 expref: 19 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.082641:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d6ec241a400) 00010000:00010000:3.0:1787380384.082646:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380384.082672:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad69a0f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.082684:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad69a0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.082694:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad69a0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787380384.082840:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c122e5ee reply state 00000000106dbda0 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad69a0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.082852:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad69a0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.082858:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d6ec241a400) 00010000:00010000:3.0:1787380384.082861:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787380384.082863:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380384.082948:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+20:12358:x1874203848563840:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 412us (585us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1787380384.082956:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 199 00000100:00100000:2.0:1787380384.086326:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380384.086401:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848563968 00000100:00100000:3.0:1787380384.086410:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848563968 00000100:00100000:3.0:1787380384.086475:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 65 00000100:00100000:3.0:1787380384.086484:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2400:x1874203848563968:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787380384.086653:0:8871:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787380384.086657:0:8871:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787380384 -> 1787380382 00002000:00010000:3.0:1787380384.086660:0:8871:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787380381 00002000:00010000:3.0:1787380384.086662:0:8871:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787380384 -> 1787380382 00002000:00010000:3.0:1787380384.086664:0:8871:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787380384.086724:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2400:x1874203848563968:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 241us (405us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787380384.086733:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 65 00000100:00100000:1.0:1787380384.089135:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380384.089217:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848564224 00000100:00100000:2.0:1787380384.089226:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848564224 00000100:00100000:2.0:1787380384.089282:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 200 00000100:00100000:2.0:1787380384.089292:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+20:12358:x1874203848564224:12345-192.168.206.30@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787380384.089357:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69a16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.089373:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad699de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aee8 expref: 20 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.089396:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69a16 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.089428:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad699de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aee8 expref: 20 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.089441:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad699de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aee8 expref: 20 pid: 10154 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380384.089455:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874203867492480:192.168.206.30@tcp:104: 00000100:00100000:2.0:1787380384.089532:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4c99b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787380384.091750:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874203867492480:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380384.091774:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69a16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380384.093078:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380384.093148:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848564352 00000100:00100000:3.0:1787380384.093156:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848564352 00010000:00010000:3.0:1787380384.093198:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad699de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aee8 expref: 21 pid: 10154 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380384.093232:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 87 00000100:00100000:3.0:1787380384.093239:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc13acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+21:2400:x1874203848564352:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380384.093250:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380384.093256:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad699de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aee8 expref: 21 pid: 10154 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.093268:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad699de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aee8 expref: 21 pid: 10154 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.093287:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad699de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aee8 expref: 21 pid: 10154 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.093317:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d6ec241a400) 00010000:00010000:3.0:1787380384.093322:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69a16 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.093330:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69a16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.093337:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69a16 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.093367:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380384.093480:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69a16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.093488:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69a16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.093523:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69a16 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.093530:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69a16 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.093536:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69a16 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.093542:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0f800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380384.093551:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69a16 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.093566:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69a16 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.093575:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d6ec241a400) 00010000:00010000:1.0:1787380384.093578:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787380384.093581:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69a16 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.093585:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f800/0xcf3c46fdcad69a16 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380384.093738:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc13acc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+20:2400:x1874203848564352:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 497us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380384.093747:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 87 00000100:00100000:1.0:1787380384.094388:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:12358:x1874203848564224:12345-192.168.206.30@tcp:55:lhsmtool_posix.0 Request processed in 5095us (5259us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787380384.094397:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 200 00000100:00100000:0.0:1787380384.097656:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380384.097757:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848564480 00000100:00100000:3.0:1787380384.097766:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848564480 00000100:00100000:3.0:1787380384.097913:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00100000:3.0:1787380384.097923:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2399:x1874203848564480:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787380384.097963:0:12152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005c2be548/0xcf3c46fdcad69a1d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.097980:0:12152:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad69a08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af04 expref: 8 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.097988:0:12152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380384.097992:0:12152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787380384.097996:0:12152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c2be548/0xcf3c46fdcad69a1d lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.098042:0:12152:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad69a08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af04 expref: 8 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.098055:0:12152:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad69a08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af04 expref: 8 pid: 8871 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380384.098069:0:12152:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12152:1874203867492608:192.168.206.30@tcp:104: 00000100:00100000:3.0:1787380384.098144:0:12152:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec2779300 going to sleep for 11 seconds 00000100:00100000:2.0:1787380384.101132:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380384.101218:0:10339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848564608 00000100:00100000:1.0:1787380384.101226:0:10339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848564608 00010000:00010000:1.0:1787380384.101264:0:10339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad69a08 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af04 expref: 9 pid: 8871 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380384.101306:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 88 00000100:00100000:1.0:1787380384.101315:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:2400:x1874203848564608:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380384.101328:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380384.101348:0:10339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad69a08 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af04 expref: 9 pid: 8871 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.101362:0:10339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad69a08 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af04 expref: 9 pid: 8871 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.101400:0:10339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787380384.101404:0:10339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787380384.101410:0:10339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c2be548/0xcf3c46fdcad69a1d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.101420:0:10339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c2be548/0xcf3c46fdcad69a1d lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.101440:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380384.101501:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:2400:x1874203848564608:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 186us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380384.101509:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 88 00010000:00010000:2.0:1787380384.103545:0:12152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad69a08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af04 expref: 8 pid: 8871 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380384.103573:0:12152:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12152:1874203867492608:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380384.103593:0:12152:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c2be548/0xcf3c46fdcad69a1d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.103603:0:12152:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c2be548/0xcf3c46fdcad69a1d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.103626:0:12152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c2be548/0xcf3c46fdcad69a1d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.103649:0:12152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005c2be548/0xcf3c46fdcad69a1d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.103657:0:12152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c2be548/0xcf3c46fdcad69a1d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.103665:0:12152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c2be548/0xcf3c46fdcad69a1d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.103672:0:12152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d800 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380384.103676:0:12152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c2be548/0xcf3c46fdcad69a1d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.103685:0:12152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c2be548/0xcf3c46fdcad69a1d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.103701:0:12152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c2be548/0xcf3c46fdcad69a1d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.103709:0:12152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c2be548/0xcf3c46fdcad69a1d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380384.103790:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2399:x1874203848564480:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 Request processed in 5868us (6338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380384.103826:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00100000:2.0:1787380384.106854:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380384.107005:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848564864 00000100:00100000:3.0:1787380384.107013:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848564864 00000100:00100000:3.0:1787380384.107060:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 201 00000100:00100000:3.0:1787380384.107069:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:12358:x1874203848564864:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787380384.107140:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69a24 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.107157:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad6986b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae8d expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.107167:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69a24 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.107315:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad6986b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae8d expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.107329:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad6986b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae8d expref: 19 pid: 6523 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380384.107363:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867492736:192.168.206.30@tcp:104: 00000100:00100000:3.0:1787380384.107440:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec27793c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380384.109391:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380384.109505:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867492736:192.168.206.30@tcp:104: 00010000:00010000:0.0:1787380384.109529:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69a24 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380384.109831:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848564992 00000100:00100000:2.0:1787380384.109838:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848564992 00010000:00010000:2.0:1787380384.109869:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad6986b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae8d expref: 20 pid: 6523 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380384.109904:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 89 00000100:00100000:2.0:1787380384.109914:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+20:2400:x1874203848564992:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380384.109927:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380384.109933:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad6986b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae8d expref: 20 pid: 6523 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.109944:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad6986b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae8d expref: 20 pid: 6523 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.109963:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f600/0xcf3c46fdcad6986b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae8d expref: 20 pid: 6523 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.109977:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:2.0:1787380384.109982:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69a24 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.109990:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69a24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.110009:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69a24 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.110026:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380384.110067:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:2400:x1874203848564992:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 155us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380384.110074:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 89 00010000:00010000:0.0:1787380384.110838:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69a24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.110849:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69a24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.111000:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69a2b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.111013:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aeef expref: 19 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.111022:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69a2b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.111052:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aeef expref: 19 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.111075:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aeef expref: 19 pid: 10154 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380384.111088:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867492864:192.168.206.30@tcp:104: 00000100:00100000:0.0:1787380384.111151:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec249f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380384.114103:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380384.114180:0:10339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848565120 00000100:00100000:2.0:1787380384.114200:0:10339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848565120 00010000:00010000:2.0:1787380384.114239:0:10339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699ec lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aeef expref: 20 pid: 10154 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380384.114276:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 90 00000100:00100000:2.0:1787380384.114285:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+20:2399:x1874203848565120:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380384.114298:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380384.114305:0:10339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699ec lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aeef expref: 20 pid: 10154 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.114317:0:10339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aeef expref: 20 pid: 10154 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.114337:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d6ec241a400) 00010000:00010000:2.0:1787380384.114342:0:10339:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69a2b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.114351:0:10339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69a2b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.114375:0:10339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69a2b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.114393:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380384.114440:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+20:2399:x1874203848565120:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 157us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380384.114447:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 90 00010000:00010000:0.0:1787380384.116066:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad699ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aeef expref: 19 pid: 10154 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380384.116088:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867492864:192.168.206.30@tcp:104: 00010000:00010000:0.0:1787380384.116111:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69a2b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.116120:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69a2b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.116126:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69a2b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787380384.116301:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1787380384.116425:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1787380384.116539:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1787380384.116689:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874203867492992:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787380384.116748:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380384.118919:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec249fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380384.119113:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867492992 00000100:00100000:1.0:1787380384.119122:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867492992 00000100:00100000:1.0:1787380384.119283:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1787380384.119295:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1874203867492992:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787380384.119418:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1874203867492992:12345-0@lo:1000:mdt00_002.0 Request processed in 124us (2667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380384.119426:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787380384.119502:0:6523:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1787380384.119508:0:6523:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6fc3b64380, transno 4294967316 00000100:00100000:3.0:1787380384.119528:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874203867492992:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787380384.119676:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1787380384.119744:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874203867493120:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787380384.119780:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380384.120227:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fe1156780 going to sleep for 11 seconds 00000100:00100000:0.0:1787380384.120365:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867493120 00000100:00100000:0.0:1787380384.120371:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867493120 00000100:00100000:0.0:1787380384.120401:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787380384.120423:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1874203867493120:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787380384.120539:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1874203867493120:12345-0@lo:1000:mdt00_002.0 Request processed in 117us (757us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787380384.120556:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787380384.120675:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874203867493120:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1787380384.120711:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69a2b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.120720:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69a2b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.120726:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69a2b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.120732:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380384.120736:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69a2b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.120742:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69a2b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.120764:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d6ec241a400) 00010000:00010000:3.0:1787380384.120766:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787380384.120770:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69a2b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.120776:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69a2b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.120805:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69960 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.120834:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69960 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.120839:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69960 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.120844:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380384.120846:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69960 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.120852:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69960 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.120859:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:3.0:1787380384.120862:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787380384.120864:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69960 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.120870:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69960 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.120902:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69a32 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.120916:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6997c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aed3 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.120924:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69a32 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.120949:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6997c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aed3 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.120961:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6997c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aed3 expref: 22 pid: 6522 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380384.120972:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f14a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867493248:192.168.206.30@tcp:104: 00000100:00100000:3.0:1787380384.121028:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787380384.124055:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380384.124115:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848565248 00000100:00100000:1.0:1787380384.124123:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848565248 00010000:00010000:1.0:1787380384.124159:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6997c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aed3 expref: 23 pid: 6522 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380384.124207:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 91 00000100:00100000:1.0:1787380384.124217:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+23:2400:x1874203848565248:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380384.124245:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380384.124253:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6997c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aed3 expref: 23 pid: 6522 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.124267:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6997c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aed3 expref: 23 pid: 6522 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.124288:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:1.0:1787380384.124294:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69a32 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.124303:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69a32 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.124310:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69a32 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380384.124328:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380384.124375:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+23:2400:x1874203848565248:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 159us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380384.124383:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 91 00010000:00010000:3.0:1787380384.125688:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad6997c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aed3 expref: 22 pid: 6522 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380384.125712:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f14a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867493248:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380384.125731:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69a32 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.125935:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69a32 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.125943:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69a32 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.125954:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69a32 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.125961:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69a32 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.125968:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69a32 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.125973:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380384.125977:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69a32 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.125983:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69a32 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.125996:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:0.0:1787380384.125999:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380384.126003:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69a32 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.126026:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69a32 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.126038:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69a24 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.126045:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69a24 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.126052:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69a24 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.126058:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89ca00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380384.126061:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69a24 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.126067:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69a24 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.126076:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6fc4767500) 00010000:00010000:0.0:1787380384.126078:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787380384.126081:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69a24 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380384.126086:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69a24 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380384.126288:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+21:12358:x1874203848564864:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 19218us (19440us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1787380384.126298:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 201 00000020:00080000:0.0:1787380384.126309:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787380384.128839:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380384.128938:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848565504 00000100:00100000:3.0:1787380384.128948:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848565504 00000100:00100000:3.0:1787380384.129000:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 50 00000100:00100000:3.0:1787380384.129010:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7be0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+21:12358:x1874203848565504:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787380384.129265:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787380384.129301:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1787380384.129333:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69a39 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.129347:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69a39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.129356:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69a39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.129363:0:6524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69a39 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.129370:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69a39 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.129376:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69a39 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380384.129401:0:6524:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787380384.129484:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7be0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+23:12358:x1874203848565504:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 474us (673us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787380384.129491:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 50 00000020:00080000:3.0:1787380384.129496:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787380384.129625:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380384.129631:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69a39 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.129639:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89dc00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380384.129643:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69a39 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.129651:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69a39 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.129662:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d6ec241a400) 00010000:00010000:2.0:1787380384.129665:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787380384.129669:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69a39 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.129674:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69a39 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380384.129686:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380384.129687:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380384.129689:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787380384.130759:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787380384.130776:0:13800:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787380384.131350:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787380384.131360:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787380384.845863:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787380385.494614:0:14713:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787380385.494623:0:14713:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787380385.494650:0:14713:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787380385.494656:0:14713:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787380385.622210:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380385.622303:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848565760 00000100:00100000:1.0:1787380385.622313:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848565760 00000100:00100000:1.0:1787380385.622374:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 202 00000100:00100000:1.0:1787380385.622384:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+23:12375:x1874203848565760:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1787380385.622407:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380385.622425:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0400/0xcf3c46fdcad69a40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af0b expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380385.622541:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad69a47 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380385.622556:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad69a47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380385.622567:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad69a47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380385.622578:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1787380385.622693:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0400/0xcf3c46fdcad69a40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af0b expref: 26 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380385.622709:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad69a47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af0b expref: 25 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380385.622718:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:1.0:1787380385.622721:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787380385.622735:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df0a00, rc 0) 00000100:00100000:1.0:1787380385.622804:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+25:12375:x1874203848565760:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 421us (602us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1787380385.622837:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 202 00000100:00100000:3.0:1787380385.628107:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380385.629856:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848565888 00000100:00100000:0.0:1787380385.629868:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848565888 00000100:00100000:0.0:1787380385.629927:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 203 00000100:00100000:0.0:1787380385.629936:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+25:12375:x1874203848565888:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:0.0:1787380385.630000:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a55 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630014:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630024:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630036:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630042:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630048:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630107:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69a63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630114:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69a63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630120:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69a63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787380385.630170:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69a63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630184:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a55 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630189:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a55 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630196:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a55 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630201:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380385.630205:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a55 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630211:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a55 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630222:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:0.0:1787380385.630225:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380385.630229:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a55 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630234:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a55 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630245:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630251:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630262:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630267:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380385.630270:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630276:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630284:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6ec26f4d00) 00010000:00010000:0.0:1787380385.630286:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380385.630289:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a5c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630295:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630310:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69a63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630315:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69a63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630321:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69a63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630326:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380385.630328:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69a63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630344:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69a63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630352:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380385.630354:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380385.630356:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69a63 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.630361:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69a63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380385.630438:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+25:12375:x1874203848565888:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 502us (2336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380385.630446:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 203 00000100:00100000:0.0:1787380385.685277:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380385.685316:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848566144 00000100:00100000:0.0:1787380385.685325:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848566144 00000100:00100000:0.0:1787380385.685372:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 204 00000100:00100000:0.0:1787380385.685381:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+25:12378:x1874203848566144:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1787380385.685400:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380385.685419:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69a6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af12 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685484:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a71 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685498:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685520:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685535:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a78 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685542:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685548:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685659:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69a7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685668:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69a7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685675:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69a7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380385.685684:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787380385.685754:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685762:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a71 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685768:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685774:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380385.685784:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685802:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a71 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685830:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:0.0:1787380385.685834:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380385.685838:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a71 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685845:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69a71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685858:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a78 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685865:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a78 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685870:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685875:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380385.685878:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a78 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685883:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a78 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685890:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380385.685892:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380385.685901:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a78 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685906:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a78 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685943:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69a6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af12 expref: 28 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685966:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69a7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af12 expref: 27 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.685973:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4d00) 00010000:00010000:0.0:1787380385.685975:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380385.685977:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866200, rc 0) 00000100:00100000:0.0:1787380385.686028:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+27:12378:x1874203848566144:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 648us (759us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787380385.686035:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 204 00000100:00100000:3.0:1787380385.690953:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380385.690984:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848566272 00000100:00100000:3.0:1787380385.690993:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848566272 00000100:00100000:3.0:1787380385.691041:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 205 00000100:00100000:3.0:1787380385.691050:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+27:12378:x1874203848566272:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:3.0:1787380385.691129:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69a8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.691145:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69a8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.691156:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69a8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.691204:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69a8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.691212:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69a8d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.691218:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69a8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.691224:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380385.691228:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69a8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.691235:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69a8d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.691246:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4d00) 00010000:00010000:3.0:1787380385.691250:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380385.691254:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69a8d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.691261:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69a8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380385.691336:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+27:12378:x1874203848566272:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 287us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380385.691344:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 205 00000100:00100000:3.0:1787380385.698608:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380385.698636:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848566528 00000100:00100000:3.0:1787380385.698653:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848566528 00000100:00100000:3.0:1787380385.698696:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 51 00000100:00100000:3.0:1787380385.698704:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+27:12378:x1874203848566528:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:3.0:1787380385.698907:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+28:12378:x1874203848566528:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 204us (304us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1787380385.698915:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 51 00000100:00100000:3.0:1787380385.748295:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380385.748391:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848566784 00000100:00100000:0.0:1787380385.748400:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848566784 00000100:00100000:0.0:1787380385.748486:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 206 00000100:00100000:0.0:1787380385.748495:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+28:11902:x1874203848566784:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1787380385.748517:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380385.748535:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69a94 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af19 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.748659:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a9b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.748683:0:10154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69a7f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af12 expref: 29 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.748691:0:10154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a9b lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.748721:0:10154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69a7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af12 expref: 29 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.748735:0:10154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69a7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af12 expref: 29 pid: 10154 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380385.748747:0:10154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10154:1874203867493376:192.168.206.30@tcp:104: 00000100:00100000:0.0:1787380385.748883:0:10154:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380385.755629:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380385.755860:0:10339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848566912 00000100:00100000:2.0:1787380385.755868:0:10339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848566912 00000100:00100000:0.0:1787380385.755876:0:10154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10154:1874203867493376:192.168.206.30@tcp:104: 00010000:00010000:0.0:1787380385.755898:0:10154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a9b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380385.755902:0:10339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69a7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af12 expref: 30 pid: 10154 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380385.755938:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 92 00000100:00100000:2.0:1787380385.755947:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+30:2400:x1874203848566912:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380385.755960:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380385.755966:0:10339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69a7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af12 expref: 30 pid: 10154 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380385.755978:0:10339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69a7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af12 expref: 30 pid: 10154 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380385.755998:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69a7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af12 expref: 30 pid: 10154 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380385.756013:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4d00) 00010000:00010000:2.0:1787380385.756017:0:10339:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a9b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380385.756042:0:10339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a9b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380385.756050:0:10339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a9b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380385.756080:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380385.756138:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+29:2400:x1874203848566912:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 192us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380385.756146:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 92 00010000:00010000:0.0:1787380385.756731:0:10154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a9b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.756739:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a9b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380385.756756:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1787380385.756903:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69a94 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af19 expref: 30 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.756930:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a9b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af19 expref: 29 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.756937:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4d00) 00010000:00010000:0.0:1787380385.756940:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787380385.756943:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867a00, rc 0) 00000100:00100000:0.0:1787380385.756969:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+29:11902:x1874203848566784:12345-192.168.206.30@tcp:101:bash.0 Request processed in 8476us (8684us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1787380385.756976:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 206 00000100:00100000:3.0:1787380385.758518:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380385.758656:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848567040 00000100:00100000:0.0:1787380385.758664:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848567040 00000100:00100000:0.0:1787380385.758711:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 207 00000100:00100000:0.0:1787380385.758721:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff66d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+29:11902:x1874203848567040:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1787380385.758742:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380385.758759:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69aa9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af20 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.758797:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69ab0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.758838:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.758849:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.758949:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69aa9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af20 expref: 31 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.758973:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af20 expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.758982:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4d00) 00010000:00010000:0.0:1787380385.758985:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787380385.758988:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866a00, rc 0) 00000100:00100000:0.0:1787380385.759030:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff66d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+30:11902:x1874203848567040:12345-192.168.206.30@tcp:101:bash.0 Request processed in 311us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380385.759036:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 207 00000100:00100000:1.0:1787380385.764054:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380385.764227:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848567296 00000100:00100000:3.0:1787380385.764236:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848567296 00000100:00100000:3.0:1787380385.764290:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 208 00000100:00100000:3.0:1787380385.764299:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+30:11902:x1874203848567296:12345-192.168.206.30@tcp:36:bash.0 00010000:00010000:3.0:1787380385.764500:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89da00/0xcf3c46fdcad69ab7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.764516:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89da00/0xcf3c46fdcad69ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.764527:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89da00/0xcf3c46fdcad69ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787380385.764594:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1787380385.764617:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061ad5a32 reply state 0000000068b79b9c transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89da00/0xcf3c46fdcad69ab7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.764630:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89da00/0xcf3c46fdcad69ab7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.764637:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4d00) 00010000:00010000:3.0:1787380385.764639:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787380385.764642:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787380385.764678:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1787380385.764842:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+34:11902:x1874203848567296:12345-192.168.206.30@tcp:36:bash.0 Request processed in 543us (794us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787380385.764850:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 208 00000020:00080000:3.0:1787380385.764855:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787380385.774551:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380385.776427:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848567424 00000100:00100000:0.0:1787380385.776441:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848567424 00000100:00100000:0.0:1787380385.776509:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 209 00000100:00100000:0.0:1787380385.776519:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+34:11902:x1874203848567424:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1787380385.777021:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380385.777043:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69abe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af27 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.777097:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69abe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af27 expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.777112:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69abe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af27 expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.777640:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4d00) 00010000:00010000:0.0:1787380385.777645:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787380385.777663:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866800, rc 0) 00000100:00100000:0.0:1787380385.777803:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+35:11902:x1874203848567424:12345-192.168.206.30@tcp:101:bash.0 Request processed in 1284us (3268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380385.777835:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 209 00000100:00100000:1.0:1787380385.785908:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380385.786171:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848567552 00000100:00100000:2.0:1787380385.786237:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848567552 00000100:00100000:2.0:1787380385.786377:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 67 00000100:00100000:2.0:1787380385.786388:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:11902:x1874203848567552:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:2.0:1787380385.786403:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380385.786423:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad69ac5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af2e expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787380385.786445:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a89429e, atime: 0x6a89429d, ctime: 0x6a89429e, blocks: 0x8 00010000:00010000:2.0:1787380385.786465:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787380385.786469:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380385.786477:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad69ac5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af2e expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380385.786493:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad69ac5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af2e expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380385.786544:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0ee00, rc 0) 00000100:00100000:2.0:1787380385.786595:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:11902:x1874203848567552:12345-192.168.206.30@tcp:101:bash.0 Request processed in 209us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380385.786603:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 67 00000100:00100000:1.0:1787380385.793775:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380385.797187:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848567680 00000100:00100000:0.0:1787380385.797200:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848567680 00002000:00010000:0.0:1787380385.797538:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1787380385.797544:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec3f9aa00 with x1874203848567680 ext(0->18446744073709551615) 00002000:00010000:0.0:1787380385.797557:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d6ec3f9aa00. 00000100:00100000:0.0:1787380385.797650:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:0.0:1787380385.797662:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2399:x1874203848567680:12345-192.168.206.30@tcp:10:bash.0 00002000:00010000:0.0:1787380385.797962:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787380385.797966:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1787380382 -> 1787380386 00002000:00010000:0.0:1787380385.797969:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1787380381 -> 1787380381 00002000:00010000:0.0:1787380385.797971:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1787380382 -> 1787380386 00002000:00010000:0.0:1787380385.797973:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1787380385.798024:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:2399:x1874203848567680:12345-192.168.206.30@tcp:10:bash.0 Request processed in 364us (4258us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1787380385.798031:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 6 00002000:00010000:0.0:1787380385.798035:0:8440:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1787380385.798037:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec3f9aa00 with x1874203848567680 ext(0->18446744073709551615) 00002000:00010000:0.0:1787380385.798041:0:8440:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d6ec3f9aa00. 00010000:00010000:2.0:1787380385.869925:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380385.915751:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380385.915944:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848567808 00000100:00100000:3.0:1787380385.915953:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848567808 00000100:00100000:3.0:1787380385.915999:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 210 00000100:00100000:3.0:1787380385.916009:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+35:12392:x1874203848567808:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:3.0:1787380385.916074:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69acc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916090:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69acc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916102:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69acc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916117:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ad3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916132:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916139:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916222:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ada lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916232:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916239:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787380385.916279:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916289:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69acc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916295:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69acc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916302:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69acc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916307:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380385.916311:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69acc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916318:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69acc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916335:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:3.0:1787380385.916338:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380385.916342:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69acc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916348:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69acc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916360:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916365:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ad3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916371:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916375:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380385.916378:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916384:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ad3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916391:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6fc6122a00) 00010000:00010000:3.0:1787380385.916393:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380385.916396:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ad3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916401:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ad3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916434:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ada lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916441:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ada lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916447:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ada lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916681:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380385.916684:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ada lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916690:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ada lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916698:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4d00) 00010000:00010000:3.0:1787380385.916701:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380385.916703:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ada lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.916709:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ada lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380385.917073:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+35:12392:x1874203848567808:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 1062us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380385.917081:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 210 00000100:00100000:1.0:1787380385.952594:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380385.952661:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380385.952847:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848568064 00000100:00100000:2.0:1787380385.952856:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848568064 00000100:00100000:2.0:1787380385.952912:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 68 00000100:00100000:2.0:1787380385.952922:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:2399:x1874203848568064:12345-192.168.206.30@tcp:16:kworker.0 00000100:00100000:3.0:1787380385.953035:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848567936 00000100:00100000:3.0:1787380385.953040:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848567936 00002000:00100000:3.0:1787380385.953066:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->7) req@ffff9d6ec4400e00 x1874203848567936/t0(0) o4->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:191/0 lens 496/0 e 0 to 0 dl 1787380396 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787380385.953083:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec4400e00 with x1874203848567936 ext(0->7) 00002000:00010000:3.0:1787380385.953089:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d6ec4400e00 00000100:00100000:3.0:1787380385.953115:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:3.0:1787380385.953122:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+10:2399:x1874203848567936:12345-192.168.206.30@tcp:4:bash.0 00000100:00100000:3.0:1787380385.954921:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4400e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+12:2399:x1874203848567936:12345-192.168.206.30@tcp:4:bash.0 Request processed in 1790us (2251us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787380385.954933:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 7 00002000:00100000:3.0:1787380385.954942:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->7) req@ffff9d6ec4400e00 x1874203848567936/t4294967320(0) o4->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:191/0 lens 496/448 e 0 to 0 dl 1787380396 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787380385.954952:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec4400e00 with x1874203848567936 ext(0->7) 00002000:00010000:3.0:1787380385.954958:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d6ec4400e00 00000001:00080000:0.0:1787380385.963563:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:0.0:1787380385.963585:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:2.0:1787380385.967183:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2399:x1874203848568064:12345-192.168.206.30@tcp:16:kworker.0 Request processed in 14246us (14582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380385.967197:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 68 00000100:00100000:1.0:1787380385.979600:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380385.979726:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848568320 00000100:00100000:3.0:1787380385.979743:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848568320 00000100:00100000:3.0:1787380385.979840:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 211 00000100:00100000:3.0:1787380385.979852:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+35:12395:x1874203848568320:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1787380385.979874:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380385.979893:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ae1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af35 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.979961:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ae8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.979975:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980003:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980017:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69aef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980025:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69aef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980037:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69aef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980137:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69af6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980146:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69af6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980153:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69af6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380385.980162:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787380385.980236:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980243:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ae8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980249:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980254:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380385.980264:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980273:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ae8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980285:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:3.0:1787380385.980288:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380385.980291:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ae8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980297:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69ae8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980310:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69aef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980316:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69aef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980323:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69aef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980328:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380385.980331:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69aef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980338:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69aef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980346:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6fc6122a00) 00010000:00010000:3.0:1787380385.980348:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380385.980357:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69aef lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980363:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69aef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980407:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ae1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af35 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980421:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69af6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af35 expref: 37 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380385.980428:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4d00) 00010000:00010000:3.0:1787380385.980431:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787380385.980433:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89ca00, rc 0) 00000100:00100000:3.0:1787380385.980480:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4400700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+37:12395:x1874203848568320:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 631us (888us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787380385.980487:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 211 00000100:00100000:1.0:1787380385.988525:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380385.988701:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848568448 00000100:00100000:0.0:1787380385.988711:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848568448 00000100:00100000:0.0:1787380385.988778:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 212 00000100:00100000:0.0:1787380385.988839:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+37:12395:x1874203848568448:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:0.0:1787380385.988903:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69b04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.988919:0:10154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a9b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af19 expref: 37 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.988928:0:10154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69b04 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.988958:0:10154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a9b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af19 expref: 37 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380385.988972:0:10154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a9b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af19 expref: 37 pid: 10154 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380385.988986:0:10154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10154:1874203867493504:192.168.206.30@tcp:104: 00000100:00100000:0.0:1787380385.989632:0:10154:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380385.995936:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380385.996120:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848568704 00000100:00100000:2.0:1787380385.996128:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848568704 00000100:00100000:2.0:1787380385.996194:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 52 00000100:00100000:2.0:1787380385.996204:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+38:6167:x1874203848568704:12345-192.168.206.30@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787380385.996450:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+39:6167:x1874203848568704:12345-192.168.206.30@tcp:35:ldlm_bl.0 Request processed in 246us (520us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787380385.996457:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 52 00000100:00100000:0.0:1787380385.997148:0:10154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17fb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10154:1874203867493504:192.168.206.30@tcp:104: 00010000:00010000:0.0:1787380385.997183:0:10154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69b04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380386.000878:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380386.000963:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848568832 00000100:00100000:2.0:1787380386.000972:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848568832 00010000:00010000:2.0:1787380386.001022:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a9b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af19 expref: 39 pid: 10154 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380386.001060:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 93 00000100:00100000:2.0:1787380386.001083:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4402a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+39:2400:x1874203848568832:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380386.001097:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380386.001104:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a9b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af19 expref: 39 pid: 10154 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.001116:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a9b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af19 expref: 39 pid: 10154 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.001136:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69a9b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af19 expref: 39 pid: 10154 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.001151:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4d00) 00010000:00010000:2.0:1787380386.001156:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69b04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.001165:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69b04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.001172:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69b04 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.001212:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380386.001253:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4402a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+38:2400:x1874203848568832:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 172us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380386.001261:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 93 00010000:00010000:3.0:1787380386.001327:0:10154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69b04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.001336:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69b04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.001383:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69b04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.001391:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69b04 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.001398:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69b04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.001411:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380386.001416:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69b04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.001424:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69b04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.001434:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4d00) 00010000:00010000:3.0:1787380386.001436:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380386.001440:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69b04 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.001446:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69b04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380386.001485:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4401500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+37:12395:x1874203848568448:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 12681us (12970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380386.001492:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 212 00000100:00080000:1.0:1787380386.002139:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380386.007468:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380386.007558:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848569088 00000100:00100000:3.0:1787380386.007568:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848569088 00000100:00100000:3.0:1787380386.007625:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 53 00000100:00100000:3.0:1787380386.007635:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+37:12395:x1874203848569088:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:3.0:1787380386.007903:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+38:12395:x1874203848569088:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 268us (454us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1787380386.007911:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 53 00000100:00100000:1.0:1787380386.105492:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380386.105655:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848569344 00000100:00100000:3.0:1787380386.105665:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848569344 00000100:00100000:3.0:1787380386.105726:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 213 00000100:00100000:3.0:1787380386.105751:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+38:12406:x1874203848569344:12345-192.168.206.30@tcp:101:cat.0 00010000:00010000:3.0:1787380386.105778:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380386.105842:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69b0b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af3c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.105911:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b12 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.105925:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b12 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.105935:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b12 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.105949:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b19 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.105956:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.105962:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.106063:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69b20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.106072:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69b20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.106080:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69b20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380386.106101:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787380386.106173:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b12 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.106181:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b12 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.106187:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.106193:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380386.106196:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.106204:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b12 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.106216:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:3.0:1787380386.106219:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380386.106233:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.106240:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.106253:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b19 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.106259:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b19 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.106275:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.106280:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380386.106283:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b19 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.106288:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b19 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.106297:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6fc6122a00) 00010000:00010000:3.0:1787380386.106299:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380386.106302:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b19 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.106307:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b19 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.106352:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69b0b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af3c expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.106366:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69b20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af3c expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.106373:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4d00) 00010000:00010000:3.0:1787380386.106375:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380386.106377:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89c400, rc 0) 00000100:00100000:3.0:1787380386.106436:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4401880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+40:12406:x1874203848569344:12345-192.168.206.30@tcp:101:cat.0 Request processed in 687us (951us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1787380386.106470:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 213 00000100:00100000:1.0:1787380386.112040:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380386.112125:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848569600 00000100:00100000:3.0:1787380386.112135:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848569600 00000100:00100000:3.0:1787380386.112187:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 54 00000100:00100000:3.0:1787380386.112197:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+40:12406:x1874203848569600:12345-192.168.206.30@tcp:35:cat.0 00000100:00100000:3.0:1787380386.112660:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+41:12406:x1874203848569600:12345-192.168.206.30@tcp:35:cat.0 Request processed in 462us (626us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1787380386.112669:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 54 00000100:00100000:2.0:1787380386.134129:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380386.134229:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848569856 00000100:00100000:3.0:1787380386.134239:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848569856 00000100:00100000:3.0:1787380386.134294:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 214 00000100:00100000:3.0:1787380386.134304:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+41:12407:x1874203848569856:12345-192.168.206.30@tcp:36:rm.0 00010000:00010000:3.0:1787380386.134376:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1787380386.134399:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69abe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af27 expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.134418:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69b20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af3c expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.134431:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69af6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af35 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.134443:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69ab0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af20 expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.134632:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4d00) 00010000:00010000:3.0:1787380386.134644:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380386.134665:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69b2e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.134677:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69b2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.134687:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69b2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.134700:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.134707:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.134713:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.134794:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b3c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.134803:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.134829:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787380386.135009:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1787380386.135020:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 396459209663ns, next at 397459207473ns, rc = 0 00010000:00010000:3.0:1787380386.135059:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69b43 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135078:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69b43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135086:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69b43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135094:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69b43 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135101:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69b43 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135107:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69b43 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135133:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380386.135150:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b3c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135157:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b3c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135163:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b3c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135169:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380386.135173:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b3c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135181:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b3c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135198:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4d00) 00010000:00010000:3.0:1787380386.135201:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787380386.135205:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b3c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135211:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b3c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135237:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69b2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135243:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69b2e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135249:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69b2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135254:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380386.135257:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69b2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135263:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69b2e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135270:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:3.0:1787380386.135272:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380386.135275:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69b2e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135282:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69b2e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787380386.135301:0:6521:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a021642d reply state 00000000b8debe17 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135313:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.135319:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6fc6122a00) 00010000:00010000:3.0:1787380386.135322:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787380386.135324:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380386.135384:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+39:12407:x1874203848569856:12345-192.168.206.30@tcp:36:rm.0 Request processed in 1080us (1262us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787380386.135391:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 214 00010000:00010000:1.0:1787380386.135841:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380386.135848:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69b43 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.135855:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89dc00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380386.135858:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69b43 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.135866:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69b43 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.135876:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4d00) 00010000:00010000:1.0:1787380386.135879:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787380386.135882:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69b43 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.135887:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69b43 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.135898:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380386.135900:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380386.135902:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380386.184560:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380386.184639:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848570112 00000100:00100000:3.0:1787380386.184648:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848570112 00000100:00100000:3.0:1787380386.184701:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 215 00000100:00100000:3.0:1787380386.184710:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+39:12413:x1874203848570112:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:3.0:1787380386.184733:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380386.184751:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69b4a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af43 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.184878:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b51 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.184892:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b51 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.184902:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b51 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.184933:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69b58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.184941:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69b58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.184949:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69b58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787380386.185234:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787380386.185351:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69b5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.185361:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69b5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.185369:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69b5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.185397:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b51 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.185405:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b51 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.185412:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b51 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.185418:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380386.185422:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b51 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.185441:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b51 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.185453:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:3.0:1787380386.185456:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380386.185460:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b51 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.185467:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b51 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787380386.185480:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000092d54194 reply state 00000000092c685f transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69b58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.185491:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69b58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.185497:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6fc6122a00) 00010000:00010000:3.0:1787380386.185499:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787380386.185502:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787380386.185525:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69b4a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af43 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.185537:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69b5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af43 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.185543:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6fc6122700) 00010000:00010000:3.0:1787380386.185545:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380386.185547:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89c400, rc 0) 00000100:00100000:3.0:1787380386.185604:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+42:12413:x1874203848570112:12345-192.168.206.30@tcp:101:bash.0 Request processed in 895us (1062us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787380386.185618:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 215 00000100:00100000:1.0:1787380386.189533:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380386.189619:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848570240 00000100:00100000:2.0:1787380386.189627:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848570240 00000100:00100000:2.0:1787380386.189702:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 69 00000100:00100000:2.0:1787380386.189713:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2398:x1874203848570240:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:2.0:1787380386.189728:0:12152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380386.189745:0:12152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69b6d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af4a expref: -99 pid: 12152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787380386.189768:0:12152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380386.189795:0:12152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1787380386.189801:0:12152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380386.189830:0:12152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69b6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af4a expref: 8 pid: 12152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.189848:0:12152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69b6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af4a expref: 8 pid: 12152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.189860:0:12152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0e400, rc 0) 00000100:00100000:2.0:1787380386.189967:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2398:x1874203848570240:12345-192.168.206.30@tcp:101:bash.0 Request processed in 255us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380386.189974:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 69 00000100:00080000:1.0:1787380386.190069:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787380386.196414:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380386.196731:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848570368 00000100:00100000:0.0:1787380386.196740:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848570368 00000100:00100000:0.0:1787380386.196891:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 70 00000100:00100000:0.0:1787380386.196901:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:12413:x1874203848570368:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1787380386.196917:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380386.196946:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a090d77/0xcf3c46fdcad69b74 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af51 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.196974:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69b6d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af4a expref: 9 pid: 12152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.196983:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380386.196987:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380386.196993:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a090d77/0xcf3c46fdcad69b74 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af51 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.197024:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69b6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af4a expref: 9 pid: 12152 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.197043:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69b6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af4a expref: 9 pid: 12152 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380386.197056:0:8435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1874203867493632:192.168.206.30@tcp:104: 00000100:00100000:0.0:1787380386.197407:0:8435:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380386.199956:0:8435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8435:1874203867493632:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380386.199986:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008a090d77/0xcf3c46fdcad69b74 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af51 expref: 9 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.200004:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866400, rc 0) 00000100:00100000:2.0:1787380386.200065:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:12413:x1874203848570368:12345-192.168.206.30@tcp:101:bash.0 Request processed in 3165us (3660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380386.200084:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 70 00000100:00100000:3.0:1787380386.200620:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380386.201602:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848570496 00000100:00100000:2.0:1787380386.201611:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848570496 00010000:00010000:2.0:1787380386.201644:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69b6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af4a expref: 9 pid: 12152 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380386.201678:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 94 00000100:00100000:2.0:1787380386.201688:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd6104c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:2400:x1874203848570496:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380386.201700:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380386.201719:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69b6d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af4a expref: 9 pid: 12152 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.201733:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69b6d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af4a expref: 9 pid: 12152 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.201755:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bfb53a2/0xcf3c46fdcad69b6d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af4a expref: 9 pid: 12152 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.201769:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380386.201773:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380386.201780:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008a090d77/0xcf3c46fdcad69b74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af51 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.201802:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a090d77/0xcf3c46fdcad69b74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af51 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.201883:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008a090d77/0xcf3c46fdcad69b74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af51 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380386.201896:0:6508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b64380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6508:1874203867493760:192.168.206.30@tcp:105: 00000100:00100000:2.0:1787380386.201955:0:6508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4c990c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380386.206075:0:6508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b64380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6508:1874203867493760:192.168.206.30@tcp:105: 00010000:00010000:2.0:1787380386.206100:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380386.206155:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd6104c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2400:x1874203848570496:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 4468us (5535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380386.206166:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 94 00000100:00100000:1.0:1787380386.209098:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380386.209180:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848570752 00000100:00100000:2.0:1787380386.209188:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848570752 00000100:00100000:2.0:1787380386.209343:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 55 00000100:00100000:2.0:1787380386.209353:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+42:12413:x1874203848570752:12345-192.168.206.30@tcp:35:bash.0 00000100:00100000:2.0:1787380386.209637:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+43:12413:x1874203848570752:12345-192.168.206.30@tcp:35:bash.0 Request processed in 284us (546us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787380386.209645:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 55 00000100:00100000:1.0:1787380386.397410:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380386.397648:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848570880 00000100:00100000:3.0:1787380386.397658:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848570880 00000100:00100000:3.0:1787380386.397760:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 216 00000100:00100000:3.0:1787380386.397771:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+43:12429:x1874203848570880:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1787380386.397805:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380386.397842:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69b7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af58 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.397901:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.397913:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.397924:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380386.397962:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787380386.397966:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787380386.397982:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.398003:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69b7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af58 expref: 45 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.398018:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af58 expref: 44 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.398056:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:3.0:1787380386.398059:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787380386.398062:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89d200, rc 0) 00000100:00100000:3.0:1787380386.398114:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4402300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+44:12429:x1874203848570880:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 346us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380386.398121:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 216 00000100:00100000:1.0:1787380386.405615:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380386.405699:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848571136 00000100:00100000:3.0:1787380386.405708:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848571136 00000100:00100000:3.0:1787380386.405918:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 217 00000100:00100000:3.0:1787380386.405929:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+44:12429:x1874203848571136:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1787380386.405947:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380386.405964:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad69b89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af5f expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.406051:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69b90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.406064:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69b90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.406074:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69b90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380386.406083:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787380386.406167:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad69b89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af5f expref: 47 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.406203:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69b90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af5f expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.406210:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6fc6122700) 00010000:00010000:3.0:1787380386.406213:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380386.406215:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89d800, rc 0) 00000100:00100000:3.0:1787380386.406265:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4403100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+46:12429:x1874203848571136:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 338us (663us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1787380386.406272:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 217 00000100:00100000:1.0:1787380386.410626:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380386.410838:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848571264 00000100:00100000:2.0:1787380386.410847:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848571264 00000100:00100000:2.0:1787380386.410909:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:2.0:1787380386.410919:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+46:2399:x1874203848571264:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380386.410933:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380386.410955:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69b90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af5f expref: 46 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.410984:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6fc6122700) 00010000:00010000:2.0:1787380386.410989:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380386.410990:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380386.411055:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848571520 00000100:00100000:3.0:1787380386.411060:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848571520 00000100:00100000:3.0:1787380386.411090:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 218 00000100:00100000:3.0:1787380386.411097:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+46:12429:x1874203848571520:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1787380386.411116:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1787380386.411121:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+46:2399:x1874203848571264:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 204us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380386.411128:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 17 00010000:00010000:3.0:1787380386.411129:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69b9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af66 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.411700:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69ba5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.411713:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.411723:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69ba5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380386.411744:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787380386.411876:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69b9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af66 expref: 48 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.411891:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69ba5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af66 expref: 47 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.411898:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6fc6122700) 00010000:00010000:2.0:1787380386.411901:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787380386.411903:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0e400, rc 0) 00000100:00100000:2.0:1787380386.411938:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4401f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+47:12429:x1874203848571520:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 841us (947us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1787380386.411945:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 218 00000100:00100000:1.0:1787380386.421157:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380386.421308:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848571648 00000100:00100000:2.0:1787380386.421318:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848571648 00000100:00100000:2.0:1787380386.421417:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 71 00000100:00100000:2.0:1787380386.421427:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2400:x1874203848571648:12345-192.168.206.30@tcp:1:lfs.0 00010000:00010000:2.0:1787380386.421469:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000524490ff/0xcf3c46fdcad69bb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.421488:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008a090d77/0xcf3c46fdcad69b74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af51 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.421496:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380386.421500:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787380386.421505:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000524490ff/0xcf3c46fdcad69bb3 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.421539:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008a090d77/0xcf3c46fdcad69b74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af51 expref: 8 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.421553:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008a090d77/0xcf3c46fdcad69b74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af51 expref: 8 pid: 8435 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380386.421567:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1874203867493888:192.168.206.30@tcp:104: 00000100:00100000:2.0:1787380386.421648:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4c99240 going to sleep for 11 seconds 00000100:00100000:3.0:1787380386.424374:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380386.424460:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848571776 00000100:00100000:0.0:1787380386.424469:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848571776 00002000:00100000:0.0:1787380386.424511:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9d6fc478fb80 x1874203848571776/t0(0) o4->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:192/0 lens 504/0 e 0 to 0 dl 1787380397 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380386.424522:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6fc478fb80 with x1874203848571776 ext(0->8) 00010000:00010000:0.0:1787380386.424531:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008a090d77/0xcf3c46fdcad69b74 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af51 expref: 9 pid: 8435 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.424576:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008a090d77/0xcf3c46fdcad69b74 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af51 expref: 9 pid: 8435 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380386.424584:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d6fc478fb80 00000100:00100000:0.0:1787380386.424660:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:0.0:1787380386.424669:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:2399:x1874203848571776:12345-192.168.206.30@tcp:4:lfs.0 00000001:00080000:3.0:1787380386.426335:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1787380386.426348:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1787380386.426579:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc478fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2399:x1874203848571776:12345-192.168.206.30@tcp:4:lfs.0 Request processed in 1908us (2210us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787380386.426588:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 2 00002000:00100000:0.0:1787380386.426597:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9d6fc478fb80 x1874203848571776/t4294967309(0) o4->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:192/0 lens 504/448 e 0 to 0 dl 1787380397 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787380386.426605:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6fc478fb80 with x1874203848571776 ext(0->8) 00010000:00010000:0.0:1787380386.426612:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008a090d77/0xcf3c46fdcad69b74 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af51 expref: 7 pid: 8435 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.426627:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008a090d77/0xcf3c46fdcad69b74 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af51 expref: 7 pid: 8435 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380386.426634:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9d6fc478fb80 00000100:00100000:2.0:1787380386.427298:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b64380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1874203867493888:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380386.427322:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000524490ff/0xcf3c46fdcad69bb3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380386.429125:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380386.429221:0:10339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848571904 00000100:00100000:2.0:1787380386.429228:0:10339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848571904 00010000:00010000:2.0:1787380386.429259:0:10339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008a090d77/0xcf3c46fdcad69b74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af51 expref: 7 pid: 8435 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380386.429297:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 95 00000100:00100000:2.0:1787380386.429306:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2398:x1874203848571904:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380386.429320:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787380386.429334:0:10339:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787380386.429337:0:10339:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1787380386 00002000:00010000:2.0:1787380386.429339:0:10339:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1787380387 00002000:00010000:2.0:1787380386.429341:0:10339:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1787380386 00002000:00010000:2.0:1787380386.429343:0:10339:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1787380386.429349:0:10339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008a090d77/0xcf3c46fdcad69b74 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af51 expref: 7 pid: 8435 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.429361:0:10339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008a090d77/0xcf3c46fdcad69b74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af51 expref: 7 pid: 8435 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.429382:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a090d77/0xcf3c46fdcad69b74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af51 expref: 7 pid: 8435 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.429397:0:10339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787380386.429401:0:10339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787380386.429407:0:10339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000524490ff/0xcf3c46fdcad69bb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.429427:0:10339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000524490ff/0xcf3c46fdcad69bb3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.429462:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380386.429510:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+6:2398:x1874203848571904:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 202us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380386.429517:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 95 00010000:00010000:2.0:1787380386.429552:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000524490ff/0xcf3c46fdcad69bb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.429562:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000524490ff/0xcf3c46fdcad69bb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.429580:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000524490ff/0xcf3c46fdcad69bb3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.429587:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000524490ff/0xcf3c46fdcad69bb3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.429594:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000524490ff/0xcf3c46fdcad69bb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.429601:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0f800 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380386.429606:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000524490ff/0xcf3c46fdcad69bb3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.429627:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000524490ff/0xcf3c46fdcad69bb3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.429638:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000524490ff/0xcf3c46fdcad69bb3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.429646:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000524490ff/0xcf3c46fdcad69bb3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380386.429690:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4403b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848571648:12345-192.168.206.30@tcp:1:lfs.0 Request processed in 8265us (8540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380386.429698:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 71 00000100:00100000:3.0:1787380386.432169:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380386.432270:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848572160 00000100:00100000:1.0:1787380386.432281:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848572160 00000100:00100000:1.0:1787380386.432331:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 56 00000100:00100000:1.0:1787380386.432341:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7be1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+47:12429:x1874203848572160:12345-192.168.206.30@tcp:35:lfs.0 00000004:00010000:1.0:1787380386.432397:0:6524:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69ba5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af66 expref: 47 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787380386.432585:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1787380386.432621:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1787380386.432922:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1787380386.432959:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69bba lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.432972:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69b5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af43 expref: 51 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.432980:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69bba lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.433009:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69b5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af43 expref: 51 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.433038:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69b5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af43 expref: 51 pid: 6522 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380386.433050:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec4401180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1874203867494016:192.168.206.30@tcp:104: 00000100:00100000:1.0:1787380386.433118:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb4a00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380386.436104:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec4401180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6524:1874203867494016:192.168.206.30@tcp:104: 00010000:00010000:1.0:1787380386.436129:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69bba lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380386.436189:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380386.437107:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848572288 00000100:00100000:1.0:1787380386.437115:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848572288 00010000:00010000:1.0:1787380386.437150:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69b5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af43 expref: 52 pid: 6522 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380386.437196:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 96 00000100:00100000:1.0:1787380386.437205:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+52:2400:x1874203848572288:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380386.437217:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380386.437224:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69b5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af43 expref: 52 pid: 6522 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.437237:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69b5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af43 expref: 52 pid: 6522 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.437257:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69b5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af43 expref: 52 pid: 6522 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.437289:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6fc6122700) 00010000:00010000:1.0:1787380386.437294:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69bba lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.437303:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69bba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.437309:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69bba lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.437339:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380386.437388:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+51:2400:x1874203848572288:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 183us (1199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380386.437396:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 96 00010000:00010000:0.0:1787380386.437545:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69bba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.437554:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69bba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787380386.437664:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1787380386.437779:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1787380386.437904:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17f9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874203867494144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787380386.437951:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380386.437978:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1787380386.438210:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867494144 00000100:00100000:2.0:1787380386.438216:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867494144 00000100:00100000:2.0:1787380386.438262:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787380386.438270:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1874203867494144:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787380386.438341:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1874203867494144:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 72us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380386.438349:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1787380386.442032:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787380386.442087:0:6524:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:0.0:1787380386.442094:0:6524:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:0.0:1787380386.442114:0:6524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6ec336ea00, transno 4294967308 00000100:00100000:0.0:1787380386.442134:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17f9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874203867494144:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787380386.442281:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1787380386.442350:0:6524:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17f9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874203867494272:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787380386.442406:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380386.442434:0:6524:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041a540 going to sleep for 11 seconds 00000100:00100000:0.0:1787380386.442473:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867494272 00000100:00100000:0.0:1787380386.442478:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867494272 00000100:00100000:0.0:1787380386.442519:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787380386.442527:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6524:x1874203867494272:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787380386.442657:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6524:x1874203867494272:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 130us (251us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787380386.442664:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787380386.442700:0:6524:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17f9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6524:1874203867494272:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787380386.443007:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1787380386.443041:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69bba lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.443067:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69bba lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.443075:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69bba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.443081:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1c00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380386.443085:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69bba lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.443093:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69bba lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.443106:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6fc6122700) 00010000:00010000:0.0:1787380386.443108:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787380386.443112:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69bba lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.443118:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69bba lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787380386.443205:0:6524:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787380386.443257:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1787380386.443267:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396767457242ns, next at 397767455347ns, rc = 0 00000001:00080000:0.0:1787380386.443274:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1787380386.443294:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6fc6122700) 00010000:00010000:0.0:1787380386.443296:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787380386.443303:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0e400/0xcf3c46fdcad69ba5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af66 expref: 55 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380386.443396:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7be1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+54:12429:x1874203848572160:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 11056us (11234us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1787380386.443404:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 56 00000020:00080000:0.0:1787380386.443408:0:6524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787380386.450083:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380386.450270:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848572416 00000100:00100000:0.0:1787380386.450280:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848572416 00000100:00100000:0.0:1787380386.450332:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 219 00000100:00100000:0.0:1787380386.450341:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec336ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+54:12429:x1874203848572416:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1787380386.450374:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380386.450396:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69bc1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af6d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.450482:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69bc1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af6d expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.450498:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69bc1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af6d expref: 55 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.450589:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:2.0:1787380386.450593:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787380386.450597:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867c00, rc 0) 00000100:00100000:2.0:1787380386.450652:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec336ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+55:12429:x1874203848572416:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 311us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380386.450660:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 219 00000100:00100000:2.0:1787380386.454623:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380386.454711:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848572672 00000100:00100000:0.0:1787380386.454721:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848572672 00000100:00100000:0.0:1787380386.454774:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 57 00000100:00100000:0.0:1787380386.454793:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+55:12429:x1874203848572672:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:0.0:1787380386.455040:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+56:12429:x1874203848572672:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 256us (422us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1787380386.455048:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 57 00000100:00100000:1.0:1787380386.563920:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380386.564020:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848572800 00000100:00100000:0.0:1787380386.564028:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848572800 00000100:00100000:0.0:1787380386.564087:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 220 00000100:00100000:0.0:1787380386.564097:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+56:12439:x1874203848572800:12345-192.168.206.30@tcp:34:lfs.0 00010000:00010000:0.0:1787380386.564164:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bc8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564193:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bc8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564204:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bc8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564216:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69bcf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564222:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69bcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564228:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69bcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564296:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69bd6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564304:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564313:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787380386.564376:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564389:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bc8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564404:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bc8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564422:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bc8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564427:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380386.564431:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bc8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564438:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bc8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564763:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:0.0:1787380386.564767:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380386.564773:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bc8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564780:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bc8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564805:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69bcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564861:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69bcf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564867:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69bcf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564872:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380386.564875:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69bcf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564892:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69bcf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564901:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6fc6122a00) 00010000:00010000:0.0:1787380386.564903:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380386.564907:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69bcf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564913:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69bcf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564923:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564929:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69bd6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564934:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564939:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380386.564942:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564947:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69bd6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564954:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380386.564956:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380386.564959:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69bd6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.564974:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69bd6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380386.565052:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4401180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+56:12439:x1874203848572800:12345-192.168.206.30@tcp:34:lfs.0 Request processed in 955us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380386.565060:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 220 00000100:00100000:2.0:1787380386.615090:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380386.615192:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848573056 00000100:00100000:1.0:1787380386.615201:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848573056 00000100:00100000:1.0:1787380386.615257:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 221 00000100:00100000:1.0:1787380386.615267:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+56:12442:x1874203848573056:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1787380386.615286:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380386.615303:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1a00/0xcf3c46fdcad69bdd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af74 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.622884:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69be4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.622909:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69be4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.622922:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69be4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.622935:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69beb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.622943:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69beb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.622948:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69beb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.623061:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bf2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.623069:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.623076:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380386.623101:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787380386.623171:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69be4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.623179:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69be4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.623185:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69be4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.623191:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380386.623195:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69be4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.623202:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69be4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.623214:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:0.0:1787380386.623217:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380386.623221:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69be4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.623227:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69be4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.623241:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69beb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.623248:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69beb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.623263:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69beb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.623268:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380386.623271:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69beb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.623278:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69beb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.623287:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6fc6122a00) 00010000:00010000:0.0:1787380386.623289:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380386.623292:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69beb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.623297:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69beb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.623337:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1a00/0xcf3c46fdcad69bdd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af74 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.623351:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af74 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.623358:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380386.623359:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380386.623361:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866400, rc 0) 00000100:00100000:0.0:1787380386.623495:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+58:12442:x1874203848573056:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 8228us (8412us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787380386.623515:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 221 00000100:00100000:1.0:1787380386.643077:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380386.643145:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848573184 00000100:00100000:0.0:1787380386.643154:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848573184 00000100:00100000:0.0:1787380386.643213:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 222 00000100:00100000:0.0:1787380386.643222:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+58:12442:x1874203848573184:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:0.0:1787380386.643286:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.643303:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.643314:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.643367:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.643374:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c00 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.643381:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.643386:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380386.643390:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.643405:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.643416:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380386.643431:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787380386.643436:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c00 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.643441:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380386.643724:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4401c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+58:12442:x1874203848573184:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 501us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380386.643732:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 222 00000100:00100000:0.0:1787380386.647834:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380386.647890:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848573440 00000100:00100000:3.0:1787380386.647900:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848573440 00000100:00100000:3.0:1787380386.648042:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00100000:3.0:1787380386.648053:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+58:12442:x1874203848573440:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:3.0:1787380386.648327:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:12442:x1874203848573440:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 275us (514us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1787380386.648335:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00100000:1.0:1787380386.745763:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380386.745941:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848573696 00000100:00100000:2.0:1787380386.745950:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848573696 00000100:00100000:2.0:1787380386.746018:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 223 00000100:00100000:2.0:1787380386.746027:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:12452:x1874203848573696:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:2.0:1787380386.746049:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380386.746051:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787380386.746088:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69b82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af58 expref: 59 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.746106:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:2.0:1787380386.746111:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380386.746123:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69c07 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af7b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.746223:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69c0e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.746236:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bf2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af74 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.746256:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69c0e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.746286:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af74 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.746299:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bf2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af74 expref: 59 pid: 6523 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380386.746312:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874203867494400:192.168.206.30@tcp:104: 00000100:00100000:2.0:1787380386.746397:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4c99240 going to sleep for 11 seconds 00000100:00100000:3.0:1787380386.749665:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874203867494400:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380386.749695:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69c0e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380386.752372:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380386.753019:0:10339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848573824 00000100:00100000:2.0:1787380386.753029:0:10339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848573824 00010000:00010000:2.0:1787380386.753124:0:10339:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bf2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af74 expref: 60 pid: 6523 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380386.753261:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 97 00000100:00100000:2.0:1787380386.753272:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4402680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:2399:x1874203848573824:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380386.753286:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380386.753293:0:10339:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bf2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af74 expref: 60 pid: 6523 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.753306:0:10339:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af74 expref: 60 pid: 6523 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.753326:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866400/0xcf3c46fdcad69bf2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af74 expref: 60 pid: 6523 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.753353:0:10339:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:2.0:1787380386.753358:0:10339:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69c0e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.753367:0:10339:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69c0e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.753374:0:10339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69c0e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380386.753411:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380386.753471:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4402680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:2399:x1874203848573824:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 200us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380386.753479:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 97 00010000:00010000:0.0:1787380386.753546:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69c0e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.753556:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69c0e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380386.753573:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787380386.753684:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f200/0xcf3c46fdcad69c07 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af7b expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.753701:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69c0e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af7b expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.753708:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380386.753711:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787380386.753713:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0f000, rc 0) 00000100:00100000:0.0:1787380386.753737:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4403800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:12452:x1874203848573696:12345-192.168.206.30@tcp:101:bash.0 Request processed in 7712us (7983us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787380386.753744:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 223 00000100:00100000:2.0:1787380386.757121:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380386.757191:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848573952 00000100:00100000:0.0:1787380386.757199:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848573952 00000100:00100000:0.0:1787380386.757246:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 224 00000100:00100000:0.0:1787380386.757255:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+59:12452:x1874203848573952:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1787380386.757277:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380386.757295:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af82 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.757325:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69c23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.757337:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69c23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.757349:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69c23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.757452:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af82 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.757470:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69c23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af82 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.757478:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380386.757481:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787380386.757484:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867000, rc 0) 00000100:00100000:0.0:1787380386.757549:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:12452:x1874203848573952:12345-192.168.206.30@tcp:101:bash.0 Request processed in 294us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380386.757557:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 224 00000100:00100000:1.0:1787380386.760979:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380386.761121:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848574208 00000100:00100000:0.0:1787380386.761129:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848574208 00000100:00100000:0.0:1787380386.761185:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 225 00000100:00100000:0.0:1787380386.761195:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+60:12452:x1874203848574208:12345-192.168.206.30@tcp:36:bash.0 00010000:00010000:0.0:1787380386.761391:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69c2a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.761405:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69c2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.761414:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69c2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787380386.761451:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1787380386.761472:0:6523:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a6dbe8c reply state 00000000ef52b500 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69c2a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.761483:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69c2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.761490:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380386.761493:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787380386.761496:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787380386.761581:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4402d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+63:12452:x1874203848574208:12345-192.168.206.30@tcp:36:bash.0 Request processed in 388us (609us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1787380386.761589:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 225 00000020:00080000:0.0:1787380386.761593:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787380386.765011:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380386.765464:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848574336 00000100:00100000:0.0:1787380386.765474:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848574336 00000100:00100000:0.0:1787380386.765621:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 226 00000100:00100000:0.0:1787380386.765632:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+63:12452:x1874203848574336:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1787380386.765666:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380386.765686:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c31 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af89 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.765771:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69c38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.765795:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69c0e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af7b expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.765804:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69c38 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.765862:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69c0e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af7b expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.765874:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69c0e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af7b expref: 64 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380386.765888:0:6521:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874203867494528:192.168.206.30@tcp:104: 00000100:00100000:0.0:1787380386.765970:0:6521:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041a540 going to sleep for 11 seconds 00000100:00100000:2.0:1787380386.769219:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380386.769348:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848574464 00000100:00100000:1.0:1787380386.769356:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848574464 00010000:00010000:1.0:1787380386.769389:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69c0e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af7b expref: 65 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380386.769426:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 98 00000100:00100000:1.0:1787380386.769435:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+65:2400:x1874203848574464:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380386.769459:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380386.769466:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69c0e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af7b expref: 65 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.769479:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69c0e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af7b expref: 65 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.769500:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:1.0:1787380386.769506:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69c38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.769515:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69c38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.769522:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69c38 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.769678:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380386.769731:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+65:2400:x1874203848574464:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 295us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380386.769739:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 98 00010000:00010000:0.0:1787380386.770400:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0f000/0xcf3c46fdcad69c0e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af7b expref: 64 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380386.770417:0:6521:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17fa680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6521:1874203867494528:192.168.206.30@tcp:104: 00010000:00010000:0.0:1787380386.770437:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69c38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.770469:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69c38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.770476:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69c38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380386.770525:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787380386.770528:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787380386.770558:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69c38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.770588:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c31 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af89 expref: 64 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.770602:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69c38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af89 expref: 63 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.770610:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380386.770613:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380386.770615:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866800, rc 0) 00000100:00100000:0.0:1787380386.770659:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4400a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+63:12452:x1874203848574336:12345-192.168.206.30@tcp:101:bash.0 Request processed in 5030us (5656us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380386.770666:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 226 00000100:00100000:2.0:1787380386.774327:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380386.774543:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848574720 00000100:00100000:0.0:1787380386.774552:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848574720 00000100:00100000:0.0:1787380386.774604:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 59 00000100:00100000:0.0:1787380386.774613:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+63:12452:x1874203848574720:12345-192.168.206.30@tcp:35:bash.0 00000100:00100000:0.0:1787380386.774844:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+64:12452:x1874203848574720:12345-192.168.206.30@tcp:35:bash.0 Request processed in 230us (523us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1787380386.774865:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 59 00000100:00100000:1.0:1787380386.848341:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380386.848483:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848574848 00000100:00100000:0.0:1787380386.848492:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848574848 00000100:00100000:3.0:1787380386.848618:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 227 00000100:00100000:3.0:1787380386.848630:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+64:12458:x1874203848574848:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1787380386.848651:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380386.848669:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad69c3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af90 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.848727:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69c46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.848739:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69c46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.848750:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69c46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380386.848801:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1787380386.848805:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787380386.848848:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69c46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.848872:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad69c3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af90 expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.848907:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69c46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af90 expref: 65 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.848916:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:3.0:1787380386.848918:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787380386.848922:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89c600, rc 0) 00000100:00100000:3.0:1787380386.848982:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4402a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+65:12458:x1874203848574848:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 354us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380386.848989:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 227 00000100:00100000:2.0:1787380386.852753:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380386.852859:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848574976 00000100:00100000:3.0:1787380386.852868:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848574976 00000100:00100000:3.0:1787380386.852922:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 228 00000100:00100000:3.0:1787380386.852932:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+65:12458:x1874203848574976:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1787380386.852951:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380386.852969:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69c4d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af97 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853027:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c54 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853054:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853065:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853076:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853090:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853097:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853166:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69c62 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853186:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69c62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853193:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69c62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380386.853230:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787380386.853234:0:10154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787380386.853251:0:10154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69c62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853262:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69c62 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853271:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c54 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853276:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c54 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853283:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853298:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380386.853303:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c54 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853310:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c54 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853322:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:3.0:1787380386.853325:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380386.853329:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c54 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853334:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c54 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853346:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853352:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853357:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853362:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380386.853364:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853371:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853390:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6fc6122a00) 00010000:00010000:3.0:1787380386.853392:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380386.853396:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c5b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853401:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853427:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69c4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af97 expref: 67 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853439:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69c62 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af97 expref: 66 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.853447:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:3.0:1787380386.853461:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380386.853464:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89d400, rc 0) 00000100:00100000:3.0:1787380386.853519:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+66:12458:x1874203848574976:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 589us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380386.853526:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 228 00000100:00100000:2.0:1787380386.857128:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380386.857180:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380386.857361:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848575360 00000100:00100000:0.0:1787380386.857369:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848575360 00000100:00100000:0.0:1787380386.857429:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:0.0:1787380386.857439:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+66:2398:x1874203848575360:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380386.857466:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380386.857488:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d400/0xcf3c46fdcad69c62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af97 expref: 66 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.857505:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380386.857509:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380386.857565:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+65:2398:x1874203848575360:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 129us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380386.857573:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:3.0:1787380386.857668:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848575232 00000100:00100000:3.0:1787380386.857673:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848575232 00000100:00100000:3.0:1787380386.857709:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 229 00000100:00100000:3.0:1787380386.857717:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+65:12458:x1874203848575232:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:3.0:1787380386.857732:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380386.857747:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69c69 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0af9e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.857898:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69c70 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.857912:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69c38 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af89 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.857921:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69c70 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.857951:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69c38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af89 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.857965:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69c38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af89 expref: 66 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380386.857978:0:6522:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874203867494656:192.168.206.30@tcp:104: 00000100:00100000:3.0:1787380386.858047:0:6522:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5780 going to sleep for 11 seconds 00000100:00100000:3.0:1787380386.860166:0:6522:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6522:1874203867494656:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380386.860199:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69c70 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380386.864252:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380386.864572:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848575488 00000100:00100000:1.0:1787380386.864582:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848575488 00010000:00010000:1.0:1787380386.864619:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69c38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af89 expref: 67 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380386.864660:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 99 00000100:00100000:1.0:1787380386.864670:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fe1215c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+67:2400:x1874203848575488:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380386.864684:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380386.864692:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69c38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af89 expref: 67 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.864707:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69c38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af89 expref: 67 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.864732:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69c38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af89 expref: 67 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.864749:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:1.0:1787380386.864754:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69c70 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.864763:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69c70 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.864772:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69c70 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380386.864840:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380386.864898:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fe1215c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+66:2400:x1874203848575488:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 229us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380386.864905:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 99 00010000:00010000:3.0:1787380386.865053:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69c70 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.865062:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69c70 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380386.865080:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787380386.865205:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69c69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af9e expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.865221:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69c70 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af9e expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.865228:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:3.0:1787380386.865231:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787380386.865232:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89dc00, rc 0) 00000100:00100000:3.0:1787380386.865258:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+66:12458:x1874203848575232:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 7542us (8138us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787380386.865265:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 229 00000100:00100000:1.0:1787380386.869500:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380386.869579:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848575744 00000100:00100000:0.0:1787380386.869589:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848575744 00000100:00100000:0.0:1787380386.869647:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:0.0:1787380386.869657:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+66:12458:x1874203848575744:12345-192.168.206.30@tcp:103:lfs.0 00010000:00010000:0.0:1787380386.869672:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380386.869694:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69bc1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af6d expref: 66 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.869712:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380386.869717:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380386.869833:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4400380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+65:12458:x1874203848575744:12345-192.168.206.30@tcp:103:lfs.0 Request processed in 154us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380386.869841:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:2.0:1787380386.874993:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380386.875079:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848575872 00000100:00100000:3.0:1787380386.875089:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848575872 00000100:00100000:3.0:1787380386.875142:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 230 00000100:00100000:3.0:1787380386.875151:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+65:12458:x1874203848575872:12345-192.168.206.30@tcp:58:lfs.0 00010000:00010000:3.0:1787380386.875258:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69c7e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.875273:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69c7e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380386.875283:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69c7e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787380386.875366:0:10154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1787380386.875441:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+65:12458:x1874203848575872:12345-192.168.206.30@tcp:58:lfs.0 Request processed in 290us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380386.875449:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 230 00000100:00100000:1.0:1787380386.878132:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380386.878205:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848576000 00000100:00100000:0.0:1787380386.878215:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848576000 00000100:00100000:0.0:1787380386.878301:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 231 00000100:00100000:0.0:1787380386.878310:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec4402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+65:12458:x1874203848576000:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1787380386.878329:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380386.878348:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0afa5 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.878401:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69c7e lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.878424:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c85 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afa5 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.878441:0:6523:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69c7e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.878454:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c85 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afa5 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.878466:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380386.878468:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787380386.878472:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c85 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afa5 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380386.878480:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866a00, rc 0) 00000100:00100000:0.0:1787380386.878555:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec4402680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+66:12458:x1874203848576000:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 246us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380386.878563:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 231 00010000:00010000:2.0:1787380386.892022:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787380387.212023:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787380387.212031:0:13800:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787380387.212070:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787380387.212077:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787380387.212192:0:13800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17fa680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1874203867494784:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787380387.215565:0:13800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787380387.221376:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380387.221858:0:13800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17fa680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1874203867494784:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787380387.222649:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848576128 00000100:00100000:3.0:1787380387.222657:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848576128 00000100:00100000:3.0:1787380387.222722:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 232 00000100:00100000:3.0:1787380387.222731:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+66:12459:x1874203848576128:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787380387.222758:0:10154:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787380387.222900:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+66:12459:x1874203848576128:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 170us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380387.222923:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 232 00000100:00100000:1.0:1787380387.226511:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380387.226639:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848576256 00000100:00100000:3.0:1787380387.226648:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848576256 00000100:00100000:3.0:1787380387.226702:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 233 00000100:00100000:3.0:1787380387.226719:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feb607c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+66:12459:x1874203848576256:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787380387.226792:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69c8c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.226832:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69c8c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.226844:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69c8c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.226883:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c93 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.226891:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c93 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.226898:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c93 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227189:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227199:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227207:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380387.227249:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787380387.227254:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787380387.227265:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227275:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69c8c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227282:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69c8c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227289:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69c8c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227294:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380387.227298:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69c8c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227306:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69c8c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227316:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6ec25a8300) 00010000:00010000:3.0:1787380387.227325:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380387.227330:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69c8c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227336:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d800/0xcf3c46fdcad69c8c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227349:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c93 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227355:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c93 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227361:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c93 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227366:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380387.227369:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c93 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227374:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c93 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227381:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9d6ec241a900) 00010000:00010000:3.0:1787380387.227384:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380387.227386:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c93 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227391:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69c93 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227411:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227423:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227428:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227435:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380387.227438:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227444:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227453:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:3.0:1787380387.227455:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380387.227458:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.227465:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69c9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380387.227543:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feb607c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+66:12459:x1874203848576256:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 Request processed in 824us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380387.227552:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 233 00000100:00100000:2.0:1787380387.241274:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380387.241539:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848576512 00000100:00100000:3.0:1787380387.241548:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848576512 00000100:00100000:3.0:1787380387.241603:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 234 00000100:00100000:3.0:1787380387.241612:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+66:12459:x1874203848576512:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380387.241631:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380387.241659:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69ca1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0afac expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.241763:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69ca8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.241787:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.241799:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380387.241831:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787380387.241895:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.241916:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69ca8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.241923:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.241928:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380387.241932:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.241944:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.241956:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:3.0:1787380387.241959:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787380387.241963:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69ca8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.241980:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69ca8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.242017:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69ca1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afac expref: 68 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.242027:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6ec25a8300) 00010000:00010000:3.0:1787380387.242030:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787380387.242034:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69ca1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afac expref: 68 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.242043:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89d200, rc 0) 00000100:00100000:3.0:1787380387.242089:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+67:12459:x1874203848576512:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 478us (823us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1787380387.242097:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 234 00000100:00100000:1.0:1787380387.248683:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380387.249141:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848576640 00000100:00100000:0.0:1787380387.249150:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848576640 00000100:00100000:0.0:1787380387.249215:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 235 00000100:00100000:0.0:1787380387.249225:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+67:12459:x1874203848576640:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787380387.249257:0:6523:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787380387.249367:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+67:12459:x1874203848576640:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 142us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380387.249375:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 235 00000100:00100000:1.0:1787380387.252956:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380387.253081:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848576896 00000100:00100000:3.0:1787380387.253090:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848576896 00000100:00100000:3.0:1787380387.253150:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 236 00000100:00100000:3.0:1787380387.253160:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+67:12459:x1874203848576896:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380387.253179:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380387.253192:0:10154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787380387.253218:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69c46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af90 expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.253236:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:3.0:1787380387.253241:0:10154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787380387.253265:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69cb6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0afb3 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787380387.253613:0:10154:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:1.0:1787380387.254609:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1800/0xcf3c46fdcad69cbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.254624:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1800/0xcf3c46fdcad69cbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.254635:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1800/0xcf3c46fdcad69cbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.254687:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d200/0xcf3c46fdcad69cb6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afb3 expref: 69 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.254712:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1800/0xcf3c46fdcad69cbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afb3 expref: 68 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.254721:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d6fc4e52100) 00010000:00010000:1.0:1787380387.254724:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380387.254726:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df1800, rc 0) 00000100:00100000:1.0:1787380387.254799:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+68:12459:x1874203848576896:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 1640us (1851us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787380387.254845:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 236 00000100:00100000:2.0:1787380387.263750:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380387.263944:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848577152 00000100:00100000:0.0:1787380387.263953:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848577152 00000100:00100000:0.0:1787380387.264005:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 237 00000100:00100000:0.0:1787380387.264014:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+68:12459:x1874203848577152:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787380387.264068:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380387.264092:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1800/0xcf3c46fdcad69cbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afb3 expref: 68 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264128:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d6fc4e52100) 00010000:00010000:0.0:1787380387.264138:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380387.264158:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69ccb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264170:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69ccb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264180:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69ccb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264193:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69cd2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xae4625ad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264200:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69cd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xae4625ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264207:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69cd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xae4625ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264244:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69ccb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264251:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69ccb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264258:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69ccb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264264:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867c00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380387.264268:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69ccb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264282:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69ccb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264304:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:0.0:1787380387.264308:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380387.264312:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69ccb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264318:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867c00/0xcf3c46fdcad69ccb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264331:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69cd2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xae4625ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264336:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69cd2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xae4625ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264342:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69cd2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xae4625ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264347:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380387.264349:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69cd2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xae4625ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264355:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69cd2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xae4625ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264362:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xae4625ad (ffff9d6ec26f4000) 00010000:00010000:0.0:1787380387.264365:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380387.264368:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69cd2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xae4625ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.264384:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69cd2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xae4625ad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380387.264658:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+67:12459:x1874203848577152:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 642us (914us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787380387.264667:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 237 00000100:00100000:3.0:1787380387.268478:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380387.268658:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848577280 00000100:00100000:0.0:1787380387.268667:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848577280 00000100:00100000:0.0:1787380387.268730:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 238 00000100:00100000:0.0:1787380387.268740:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+67:12459:x1874203848577280:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380387.268758:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380387.268786:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69cd9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0afba expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.268851:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69ce0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.268865:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.268875:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.268988:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69cd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afba expref: 69 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.269004:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69ce0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afba expref: 68 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.269023:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d6ec26f4b00) 00010000:00010000:0.0:1787380387.269026:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787380387.269030:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866200, rc 0) 00000100:00100000:0.0:1787380387.269074:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+68:12459:x1874203848577280:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 336us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380387.269081:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 238 00000100:00100000:1.0:1787380387.277218:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380387.277288:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848577536 00000100:00100000:3.0:1787380387.277296:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848577536 00000100:00100000:3.0:1787380387.277350:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 239 00000100:00100000:3.0:1787380387.277360:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+68:12459:x1874203848577536:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787380387.277429:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ce7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.277444:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.277455:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787380387.277593:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1787380387.277603:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 397601792922ns, next at 398601790726ns, rc = 0 00000004:00010000:3.0:1787380387.277644:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d8282697 reply state 000000001d15b814 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ce7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.277657:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ce7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.277665:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d6ec26f4b00) 00010000:00010000:3.0:1787380387.277668:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1787380387.277671:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787380387.278061:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+70:12459:x1874203848577536:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 701us (849us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1787380387.278081:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 239 00000100:00100000:2.0:1787380387.290156:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380387.290330:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848577664 00000100:00100000:0.0:1787380387.290338:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848577664 00000100:00100000:0.0:1787380387.290435:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 240 00000100:00100000:0.0:1787380387.290445:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+70:12459:x1874203848577664:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380387.290469:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380387.290487:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69cee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0afc1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.290551:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69cee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afc1 expref: 71 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.290565:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69cee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afc1 expref: 71 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.290584:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d6ec26f4b00) 00010000:00010000:0.0:1787380387.290587:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787380387.290590:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866600, rc 0) 00000100:00100000:0.0:1787380387.290684:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+71:12459:x1874203848577664:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 240us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380387.290719:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 240 00000100:00100000:2.0:1787380387.297262:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380387.297387:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848577792 00000100:00100000:3.0:1787380387.297396:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848577792 00000100:00100000:3.0:1787380387.297465:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 72 00000100:00100000:3.0:1787380387.297475:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2399:x1874203848577792:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787380387.297675:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2399:x1874203848577792:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 201us (419us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787380387.297683:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 72 00000100:00080000:0.0:1787380387.297845:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380387.300803:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380387.301308:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848578048 00000100:00100000:0.0:1787380387.301317:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848578048 00000100:00100000:0.0:1787380387.301411:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 60 00000100:00100000:0.0:1787380387.301421:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+71:12459:x1874203848578048:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787380387.301637:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+72:12459:x1874203848578048:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 217us (840us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1787380387.301646:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 60 00000100:00100000:3.0:1787380387.303556:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380387.303941:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848578304 00000100:00100000:1.0:1787380387.303950:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848578304 00000100:00100000:1.0:1787380387.304002:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 241 00000100:00100000:1.0:1787380387.304012:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+72:12459:x1874203848578304:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787380387.304099:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+72:12459:x1874203848578304:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 89us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380387.304106:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 241 00000100:00100000:3.0:1787380387.305987:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380387.306077:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848578432 00000100:00100000:1.0:1787380387.306084:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848578432 00000100:00100000:1.0:1787380387.306176:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 242 00000100:00100000:1.0:1787380387.306186:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+72:12459:x1874203848578432:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787380387.306201:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380387.306219:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1800/0xcf3c46fdcad69cf5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0afc8 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.306277:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69cfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.306290:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69cfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.306301:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69cfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380387.306341:0:10154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787380387.306373:0:10154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69cfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.306398:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1800/0xcf3c46fdcad69cf5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afc8 expref: 74 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.306414:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69cfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afc8 expref: 73 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.306423:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d6ec26f4b00) 00010000:00010000:1.0:1787380387.306426:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787380387.306429:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df1e00, rc 0) 00000100:00100000:1.0:1787380387.306474:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+73:12459:x1874203848578432:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 290us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380387.306481:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 242 00000100:00100000:3.0:1787380387.309052:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380387.309320:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848578560 00000100:00100000:1.0:1787380387.309329:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848578560 00000100:00100000:1.0:1787380387.309372:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 73 00000100:00100000:1.0:1787380387.309381:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2400:x1874203848578560:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787380387.309396:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380387.309414:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d03 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0afcf expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787380387.309435:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8942a3, blocks: 0x0 00010000:00010000:1.0:1787380387.309452:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1787380387.309456:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380387.309464:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afcf expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.309498:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afcf expref: 9 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.309509:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df0800, rc 0) 00000100:00100000:1.0:1787380387.309563:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:2400:x1874203848578560:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 183us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380387.309570:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 73 00000100:00100000:3.0:1787380387.312897:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380387.313044:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848578816 00000100:00100000:1.0:1787380387.313053:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848578816 00000100:00100000:1.0:1787380387.313104:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 243 00000100:00100000:1.0:1787380387.313113:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+73:12459:x1874203848578816:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787380387.313220:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+73:12459:x1874203848578816:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 108us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380387.313228:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 243 00000100:00100000:3.0:1787380387.316213:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380387.316291:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848578944 00000100:00100000:2.0:1787380387.316299:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848578944 00000100:00100000:2.0:1787380387.316350:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 74 00000100:00100000:2.0:1787380387.316360:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:12459:x1874203848578944:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380387.316377:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380387.316392:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad69d0a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0afd6 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380387.316419:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d03 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afcf expref: 10 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380387.316428:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380387.316431:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380387.316436:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad69d0a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afd6 expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380387.316465:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afcf expref: 10 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380387.316478:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afcf expref: 10 pid: 8435 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380387.316491:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1874203867494912:192.168.206.30@tcp:104: 00000100:00100000:2.0:1787380387.316588:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4c996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380387.318667:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1874203867494912:192.168.206.30@tcp:104: 00010000:00010000:0.0:1787380387.318697:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad69d0a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afd6 expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.318726:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0fc00, rc 0) 00000100:00100000:0.0:1787380387.318788:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+10:12459:x1874203848578944:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 2419us (2571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380387.318798:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 74 00000100:00100000:0.0:1787380387.320944:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380387.321044:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848579072 00000100:00100000:1.0:1787380387.321052:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848579072 00010000:00010000:1.0:1787380387.321086:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afcf expref: 10 pid: 8435 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380387.321148:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 100 00000100:00100000:1.0:1787380387.321158:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+10:2399:x1874203848579072:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380387.321179:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380387.321198:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afcf expref: 10 pid: 8435 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.321223:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afcf expref: 10 pid: 8435 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.321245:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d03 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afcf expref: 10 pid: 8435 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.321261:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380387.321265:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380387.321273:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad69d0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afd6 expref: 9 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.321284:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad69d0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afd6 expref: 9 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.321316:0:6506:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad69d0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afd6 expref: 9 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380387.321329:0:6506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b64700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6506:1874203867495040:192.168.206.30@tcp:105: 00000100:00100000:1.0:1787380387.321398:0:6506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb4a0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787380387.324548:0:6506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b64700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6506:1874203867495040:192.168.206.30@tcp:105: 00010000:00010000:1.0:1787380387.324571:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380387.324627:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:2399:x1874203848579072:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 3470us (3688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380387.324637:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 100 00000100:00100000:2.0:1787380387.326646:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380387.326723:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848579200 00000100:00100000:3.0:1787380387.326732:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848579200 00002000:00100000:3.0:1787380387.326773:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9d6ec44a8380 x1874203848579200/t0(0) o4->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:193/0 lens 504/0 e 0 to 0 dl 1787380398 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787380387.326794:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec44a8380 with x1874203848579200 ext(0->12) 00002000:00010000:3.0:1787380387.326800:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d6ec44a8380 00000100:00100000:3.0:1787380387.326849:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:3.0:1787380387.326858:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:2399:x1874203848579200:12345-192.168.206.30@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787380387.327911:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+11:2399:x1874203848579200:12345-192.168.206.30@tcp:4:lhsmtool_posix.0 Request processed in 1049us (1267us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787380387.327921:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 8 00002000:00100000:3.0:1787380387.327937:0:8441:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9d6ec44a8380 x1874203848579200/t4294967322(0) o4->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:193/0 lens 504/448 e 0 to 0 dl 1787380398 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787380387.327946:0:8441:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6ec44a8380 with x1874203848579200 ext(0->12) 00002000:00010000:3.0:1787380387.327951:0:8441:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d6ec44a8380 00000100:00100000:3.0:1787380387.329872:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380387.329998:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848579328 00000100:00100000:0.0:1787380387.330007:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848579328 00000100:00100000:0.0:1787380387.330058:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 244 00000100:00100000:0.0:1787380387.330067:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+73:12459:x1874203848579328:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787380387.332497:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1787380387.332515:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1787380387.332565:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1787380387.332587:0:6500:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d6fd041ae40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787380387.332592:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ff3e88300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d6fd041a900 00000020:00080000:0.0:1787380387.332595:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ff3e88700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d6ec45b7e00 00000004:00080000:0.0:1787380387.332621:0:6500:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1787380387.332643:0:6500:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d6ec2779a80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787380387.332646:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ec3eaa800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d6ec2779540 00000020:00080000:0.0:1787380387.332650:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ec3eaad00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d6ec2059400 00000020:00080000:0.0:1787380387.332673:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1787380387.332742:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1787380387.332878:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+27:12459:x1874203848579328:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 Request processed in 2808us (3008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380387.332888:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 244 00000100:00100000:2.0:1787380387.333046:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867495296:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787380387.333102:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380387.333133:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380387.333139:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867495168:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787380387.333158:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380387.333187:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867495296 00000100:00100000:2.0:1787380387.333193:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867495296 00000100:00100000:2.0:1787380387.333233:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867495168 00000100:00100000:2.0:1787380387.333237:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867495168 00000100:00100000:2.0:1787380387.333255:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787380387.333262:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1874203867495296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787380387.333427:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867495424:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787380387.333458:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380387.333499:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867495424 00000100:00100000:1.0:1787380387.333502:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867495424 00010000:00010000:3.0:1787380387.333506:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad69a0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.333518:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad69a0f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380387.333525:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00010000:00010000:3.0:1787380387.333529:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad69a0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380387.333535:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3640:x1874203867495168:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1787380387.333541:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89ce00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380387.333546:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad69a0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787380387.333553:0:8433:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:3.0:1787380387.333554:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad69a0f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.333573:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.333578:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9d6ec241a400) 00010000:00010000:3.0:1787380387.333586:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380387.333593:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad69a0f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.333597:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad69ac5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af2e expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.333602:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ce00/0xcf3c46fdcad69a0f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.333614:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787380387.333619:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787380387.333624:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d11 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.333640:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89da00/0xcf3c46fdcad69ab7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.333650:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad69ac5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af2e expref: 10 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.333672:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89da00/0xcf3c46fdcad69ab7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.333677:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad69ac5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af2e expref: 10 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.333681:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89da00/0xcf3c46fdcad69ab7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.333696:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89da00 already unused, calling callback (ffffffffc19bc4f0) 00000100:00100000:1.0:1787380387.333700:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1874203867495552:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380387.333701:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89da00/0xcf3c46fdcad69ab7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.333711:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89da00/0xcf3c46fdcad69ab7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.333721:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9d6ec26f4d00) 00010000:00010000:3.0:1787380387.333723:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380387.333727:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89da00/0xcf3c46fdcad69ab7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.333732:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89da00/0xcf3c46fdcad69ab7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380387.333753:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb4a0a80 going to sleep for 11 seconds 00010000:00010000:3.0:1787380387.333756:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b35 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.333765:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b35 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.333771:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.333785:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380387.333796:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b35 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787380387.333801:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787380387.333802:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b35 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.333840:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6fc6122a00) 00000100:00100000:1.0:1787380387.333841:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00010000:00010000:3.0:1787380387.333846:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380387.333850:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b35 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380387.333854:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3641:x1874203867495424:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1787380387.333860:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69b35 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787380387.333871:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:3.0:1787380387.333877:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69b58 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.333885:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69b58 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.333891:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69b58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787380387.333893:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a8942a2, atime: 0x6a8942a3, ctime: 0x6a8942a2, blocks: 0x8 00010000:00010000:3.0:1787380387.333902:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89ca00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380387.333905:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d954ff3/0xcf3c46fdcad69d18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.333907:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69b58 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.333925:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=397s v=(0 0) 00010000:00010000:3.0:1787380387.333926:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69b58 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.333933:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380387.333940:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d954ff3/0xcf3c46fdcad69d18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.333953:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d954ff3/0xcf3c46fdcad69d18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.333962:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d954ff3/0xcf3c46fdcad69d18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.333969:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d954ff3/0xcf3c46fdcad69d18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.333985:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787380387.334084:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3641:x1874203867495424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 232us (624us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787380387.334091:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000004:00080000:1.0:1787380387.334125:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6fc3b64700/2, rc 0, transno 4294967311 00000100:00100000:1.0:1787380387.334138:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867495424:0@lo:6:osp-syn-1-0.0 00002000:00010000:2.0:1787380387.334228:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787380387.334231:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1787380387 00002000:00010000:2.0:1787380387.334234:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787380387.334236:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787380387 -> 1787380387 00002000:00010000:2.0:1787380387.334238:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1787380387.334274:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3640:x1874203867495296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1012us (1171us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787380387.334281:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1787380387.334299:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380387.334304:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d954ff3/0xcf3c46fdcad69d18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380387.334312:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1800 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380387.334315:0:8451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d954ff3/0xcf3c46fdcad69d18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.334496:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6fc6122a00) 00010000:00010000:3.0:1787380387.334500:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380387.334509:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69b58 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.334516:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69b58 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380387.334585:0:8451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d954ff3/0xcf3c46fdcad69d18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380387.334607:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d954ff3/0xcf3c46fdcad69d18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380387.334614:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d954ff3/0xcf3c46fdcad69d18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380387.334631:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380387.334633:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380387.334635:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380387.334656:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:2.0:1787380387.334660:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00010000:00010000:3.0:1787380387.334751:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69c2a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.334759:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69c2a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.334764:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69c2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.334770:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867800 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380387.334773:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69c2a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.334787:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69c2a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.334797:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:3.0:1787380387.334799:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380387.334802:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69c2a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.334831:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867800/0xcf3c46fdcad69c2a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.334845:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ce7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.334851:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ce7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.334862:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ce7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.334867:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380387.334870:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ce7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.334876:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ce7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.334885:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d6ec26f4b00) 00010000:00010000:3.0:1787380387.334887:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787380387.334890:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ce7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.334896:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69ce7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380387.335542:0:3640:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9d6ec44abb80 x1874203867495296/t4294967323(4294967323) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787380403 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787380387.335554:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6ec44abb80/2, rc 0, transno 4294967323 00000100:00100000:2.0:1787380387.335558:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867495296:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787380387.339773:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380387.339861:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380387.339984:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848579584 00000100:00100000:3.0:1787380387.339993:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848579584 00010000:00010000:3.0:1787380387.340025:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad69ac5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af2e expref: 11 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380387.340063:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 101 00000100:00100000:3.0:1787380387.340073:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+11:2400:x1874203848579584:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380387.340086:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380387.340092:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad69ac5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af2e expref: 11 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.340121:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad69ac5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af2e expref: 11 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.340143:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787380387.340147:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787380387.340153:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.340162:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d11 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.340192:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380387.340239:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+11:2400:x1874203848579584:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 168us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380387.340248:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 101 00000100:00100000:1.0:1787380387.340752:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848579456 00000100:00100000:1.0:1787380387.340758:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848579456 00000100:00100000:1.0:1787380387.340799:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 78 00000100:00100000:1.0:1787380387.340830:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+11:2397:x1874203848579456:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1787380387.341315:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad69ac5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af2e expref: 11 pid: 8435 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380387.341346:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1874203867495552:192.168.206.30@tcp:104: 00010000:00010000:0.0:1787380387.341371:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.341382:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.341390:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.341411:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.341419:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.341441:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787380387.341689:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3640:x1874203867495168:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8143us (8516us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787380387.341697:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:2.0:1787380387.343636:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380387.343658:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380387.343670:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df0800 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380387.343675:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380387.343703:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380387.343723:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380387.343731:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b012271/0xcf3c46fdcad69d11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380387.343751:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380387.343754:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380387.343756:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787380387.343828:0:3640:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6ec44a9f80/2, rc 0, transno 4294967324 00000100:00100000:2.0:1787380387.343836:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867495168:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1787380387.344100:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1787380387.344108:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:1.0:1787380387.344355:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2397:x1874203848579456:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 Request processed in 3547us (4587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380387.344365:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 78 00000100:00100000:2.0:1787380387.350661:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380387.355465:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848579840 00000100:00100000:1.0:1787380387.355479:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848579840 00000100:00100000:1.0:1787380387.355554:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 245 00000100:00100000:1.0:1787380387.355564:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+21:12459:x1874203848579840:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787380387.355610:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380387.355634:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69cfc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afc8 expref: 21 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.355652:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d6ec26f4b00) 00010000:00010000:1.0:1787380387.355657:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380387.355683:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1000/0xcf3c46fdcad69d1f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.355696:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1000/0xcf3c46fdcad69d1f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.355706:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1000/0xcf3c46fdcad69d1f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787380387.356059:0:6522:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007d8af245 reply state 000000006cbfac3b transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1000/0xcf3c46fdcad69d1f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.356085:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1000/0xcf3c46fdcad69d1f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.356092:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d6ec26f4b00) 00010000:00010000:1.0:1787380387.356095:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787380387.356097:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787380387.356300:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:12459:x1874203848579840:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 736us (5645us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1787380387.356307:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 245 00000100:00100000:2.0:1787380387.358430:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380387.358509:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848579968 00000100:00100000:3.0:1787380387.358517:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848579968 00000100:00100000:3.0:1787380387.358580:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 79 00000100:00100000:3.0:1787380387.358589:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2399:x1874203848579968:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787380387.358705:0:8871:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787380387.358709:0:8871:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1787380387 -> 1787380387 00002000:00010000:3.0:1787380387.358711:0:8871:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1787380387 00002000:00010000:3.0:1787380387.358714:0:8871:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1787380387 -> 1787380387 00002000:00010000:3.0:1787380387.358727:0:8871:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1787380387.358849:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2399:x1874203848579968:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 261us (425us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787380387.358858:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 79 00000100:00100000:0.0:1787380387.364878:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380387.365125:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848580224 00000100:00100000:3.0:1787380387.365134:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848580224 00000100:00100000:3.0:1787380387.365191:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 246 00000100:00100000:3.0:1787380387.365200:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:12459:x1874203848580224:12345-192.168.206.30@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787380387.365258:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69d26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.365273:0:10154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69ce0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afba expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.365283:0:10154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69d26 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.365313:0:10154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69ce0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afba expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.365327:0:10154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69ce0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afba expref: 22 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380387.365340:0:10154:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10154:1874203867495680:192.168.206.30@tcp:104: 00000100:00100000:3.0:1787380387.365413:0:10154:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5540 going to sleep for 11 seconds 00000100:00100000:3.0:1787380387.367674:0:10154:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10154:1874203867495680:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380387.367699:0:10154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69d26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380387.368518:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380387.368601:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848580352 00000100:00100000:1.0:1787380387.368608:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848580352 00010000:00010000:1.0:1787380387.368641:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69ce0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afba expref: 23 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380387.368678:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 102 00000100:00100000:1.0:1787380387.368687:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+23:2399:x1874203848580352:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380387.368700:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380387.368707:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69ce0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afba expref: 23 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.368720:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69ce0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afba expref: 23 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.368739:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69ce0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afba expref: 23 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.368754:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d6ec26f4b00) 00010000:00010000:1.0:1787380387.368767:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69d26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.368785:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69d26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.368793:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69d26 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.368860:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380387.368912:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:2399:x1874203848580352:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 216us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380387.368921:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 102 00010000:00010000:0.0:1787380387.369439:0:10154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69d26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.369449:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69d26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.369484:0:10154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69d26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.369491:0:10154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69d26 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.369497:0:10154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69d26 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.369502:0:10154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380387.369513:0:10154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69d26 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.369520:0:10154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69d26 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.369541:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d6ec26f4b00) 00010000:00010000:0.0:1787380387.369545:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787380387.369548:0:10154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69d26 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.369555:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad69d26 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380387.369608:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+21:12459:x1874203848580224:12345-192.168.206.30@tcp:55:lhsmtool_posix.0 Request processed in 4409us (4737us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787380387.369617:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 246 00000100:00100000:0.0:1787380387.373789:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380387.374308:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848580480 00000100:00100000:1.0:1787380387.374317:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848580480 00000100:00100000:1.0:1787380387.374406:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 80 00000100:00100000:1.0:1787380387.374416:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2398:x1874203848580480:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787380387.374471:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fc7e55b6/0xcf3c46fdcad69d2d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.374490:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad69d0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afd6 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.374497:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380387.374501:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787380387.374506:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc7e55b6/0xcf3c46fdcad69d2d lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.374548:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad69d0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afd6 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.374573:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad69d0a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afd6 expref: 8 pid: 8433 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380387.374586:0:8433:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1874203867495808:192.168.206.30@tcp:104: 00000100:00100000:1.0:1787380387.374651:0:8433:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb4a03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380387.381163:0:8433:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1874203867495808:192.168.206.30@tcp:104: 00010000:00010000:1.0:1787380387.381191:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fc7e55b6/0xcf3c46fdcad69d2d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380387.389156:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380387.389496:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848580608 00000100:00100000:3.0:1787380387.389507:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848580608 00010000:00010000:3.0:1787380387.389555:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad69d0a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afd6 expref: 9 pid: 8433 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380387.389604:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 103 00000100:00100000:3.0:1787380387.389613:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+9:2400:x1874203848580608:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380387.389628:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380387.389648:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad69d0a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afd6 expref: 9 pid: 8433 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.389661:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad69d0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afd6 expref: 9 pid: 8433 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.389685:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad69d0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afd6 expref: 9 pid: 8433 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.389712:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787380387.389717:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787380387.389723:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc7e55b6/0xcf3c46fdcad69d2d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.389732:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc7e55b6/0xcf3c46fdcad69d2d lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.389797:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380387.389883:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2400:x1874203848580608:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 271us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380387.389891:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 103 00010000:00010000:1.0:1787380387.390178:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fc7e55b6/0xcf3c46fdcad69d2d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.390188:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc7e55b6/0xcf3c46fdcad69d2d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.390207:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fc7e55b6/0xcf3c46fdcad69d2d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.390217:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc7e55b6/0xcf3c46fdcad69d2d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.390225:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc7e55b6/0xcf3c46fdcad69d2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.390244:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1e00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380387.390249:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc7e55b6/0xcf3c46fdcad69d2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.390258:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc7e55b6/0xcf3c46fdcad69d2d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.390270:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc7e55b6/0xcf3c46fdcad69d2d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.390278:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc7e55b6/0xcf3c46fdcad69d2d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380387.390323:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2398:x1874203848580480:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 Request processed in 15909us (16621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380387.390331:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 80 00000100:00100000:2.0:1787380387.394058:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380387.397875:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848580864 00000100:00100000:3.0:1787380387.397889:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848580864 00000100:00100000:3.0:1787380387.397997:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 247 00000100:00100000:3.0:1787380387.398007:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+21:12459:x1874203848580864:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787380387.398075:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69d34 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.398101:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69c23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af82 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.398210:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69d34 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.398247:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69c23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af82 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.398260:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69c23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af82 expref: 21 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380387.398273:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867495936:192.168.206.30@tcp:104: 00000100:00100000:3.0:1787380387.398643:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5540 going to sleep for 11 seconds 00000100:00100000:3.0:1787380387.401473:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867495936:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380387.401515:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69d34 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380387.403316:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380387.403959:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848580992 00000100:00100000:1.0:1787380387.403969:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848580992 00010000:00010000:1.0:1787380387.404005:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69c23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af82 expref: 22 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380387.404043:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 104 00000100:00100000:1.0:1787380387.404051:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:2399:x1874203848580992:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380387.404064:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380387.404082:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69c23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af82 expref: 22 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.404095:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69c23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af82 expref: 22 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.404676:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69c23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af82 expref: 22 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.404756:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:1.0:1787380387.404763:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afa5 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.404772:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69d34 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.404792:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69d34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.404799:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69d34 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.404865:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380387.404983:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+21:2399:x1874203848580992:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 931us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380387.404991:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 104 00010000:00010000:3.0:1787380387.405395:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69d34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.405404:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69d34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.405669:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69d3b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.405683:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69cee lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afc1 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.405691:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69d3b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.405858:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69cee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afc1 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.405872:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69cee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afc1 expref: 21 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380387.405885:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867496064:192.168.206.30@tcp:104: 00000100:00100000:3.0:1787380387.406045:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5480 going to sleep for 11 seconds 00000100:00100000:3.0:1787380387.408630:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867496064:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380387.408657:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69d3b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380387.411314:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380387.411549:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848581120 00000100:00100000:3.0:1787380387.411557:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848581120 00010000:00010000:3.0:1787380387.411589:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69cee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afc1 expref: 22 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380387.411623:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 105 00000100:00100000:3.0:1787380387.411630:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd6825c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:2400:x1874203848581120:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380387.411642:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380387.411648:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69cee lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afc1 expref: 22 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.411668:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69cee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afc1 expref: 22 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.411688:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad69cee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afc1 expref: 22 pid: 6521 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.411710:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d6ec26f4b00) 00010000:00010000:3.0:1787380387.411716:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69d3b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.411724:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69d3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.411732:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69d3b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.411760:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380387.411805:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69d3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.411830:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69d3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380387.411851:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd6825c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+21:2400:x1874203848581120:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 220us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380387.411858:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 105 00000001:00080000:1.0:1787380387.412000:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1787380387.413506:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1787380387.413567:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1787380387.413642:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b64000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874203867496192:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787380387.413711:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380387.413741:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fca5d2180 going to sleep for 11 seconds 00000100:00100000:2.0:1787380387.413761:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867496192 00000100:00100000:2.0:1787380387.413767:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867496192 00000100:00100000:2.0:1787380387.413837:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787380387.413847:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6523:x1874203867496192:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787380387.413932:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6523:x1874203867496192:12345-0@lo:1000:mdt00_002.0 Request processed in 86us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380387.413953:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787380387.415151:0:6523:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1787380387.415160:0:6523:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6ec44abb80, transno 4294967323 00000100:00100000:1.0:1787380387.415182:0:6523:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9d6ec44a9f80 x1874203867495168/t4294967324(4294967324) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787380403 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380387.415193:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b64000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874203867496192:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787380387.415704:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1787380387.415770:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b64000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874203867496320:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787380387.415846:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380387.415927:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb4a0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787380387.416443:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867496320 00000100:00100000:0.0:1787380387.416451:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867496320 00000100:00100000:0.0:1787380387.416532:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787380387.416542:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1874203867496320:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787380387.416668:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6523:x1874203867496320:12345-0@lo:1000:mdt00_002.0 Request processed in 126us (820us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1787380387.416675:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1787380387.416742:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b64000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6523:1874203867496320:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787380387.416789:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69d3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.416799:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69d3b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.416829:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69d3b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.416836:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89ca00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380387.416841:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69d3b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.416860:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69d3b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.416875:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d6ec26f4b00) 00010000:00010000:1.0:1787380387.416878:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787380387.416882:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69d3b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.416888:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89ca00/0xcf3c46fdcad69d3b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.416922:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69c7e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.416928:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69c7e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.416933:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69c7e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.416937:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89de00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380387.416940:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69c7e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.416946:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69c7e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.416954:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:1.0:1787380387.416956:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787380387.416963:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c85 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afa5 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.416984:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c85 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afa5 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.416992:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c85 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afa5 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.417017:0:6523:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c85 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afa5 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380387.417027:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867496448:192.168.206.30@tcp:105: 00000100:00100000:1.0:1787380387.417104:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fca5d2180 going to sleep for 11 seconds 00000100:00100000:1.0:1787380387.422258:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867496448:192.168.206.30@tcp:105: 00010000:00010000:1.0:1787380387.422284:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69c7e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.422294:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89de00/0xcf3c46fdcad69c7e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.422322:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69d42 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.422335:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69d42 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.422345:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69d42 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.422354:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69d42 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.422370:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69d42 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.422377:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69d42 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.422382:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1e00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380387.422386:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69d42 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.422393:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69d42 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.422403:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:1.0:1787380387.422406:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380387.422410:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69d42 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.422415:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69d42 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.422424:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69d34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.422430:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69d34 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.422436:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69d34 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.422451:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380387.422459:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69d34 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.422465:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69d34 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.422473:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:1.0:1787380387.422475:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787380387.422478:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69d34 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.422484:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c600/0xcf3c46fdcad69d34 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380387.422620:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+24:12459:x1874203848580864:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 24615us (28569us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1787380387.422630:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 247 00000020:00080000:1.0:1787380387.422634:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787380387.423041:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787380387.423046:0:13800:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787380387.424284:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787380387.424303:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787380387.424411:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380387.424837:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848581248 00000100:00100000:3.0:1787380387.424845:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848581248 00000100:00100000:3.0:1787380387.424894:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 61 00000100:00100000:3.0:1787380387.424903:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+24:12458:x1874203848581248:12345-192.168.206.30@tcp:49:lfs.0 00000100:00100000:3.0:1787380387.425020:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+24:12458:x1874203848581248:12345-192.168.206.30@tcp:49:lfs.0 Request processed in 118us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380387.425027:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 61 00000100:00100000:2.0:1787380387.427427:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380387.427661:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848581504 00000100:00100000:0.0:1787380387.427670:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848581504 00000100:00100000:0.0:1787380387.428084:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 62 00000100:00100000:0.0:1787380387.428104:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7be3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+24:12459:x1874203848581504:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787380387.428333:0:6525:0:(mdd_object.c:4010:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787380387.428361:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:0.0:1787380387.428391:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69d49 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.428405:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69d49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.428414:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69d49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.428422:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69d49 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.428428:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69d49 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.428433:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69d49 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380387.428469:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787380387.428731:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7be3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+26:12459:x1874203848581504:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 628us (1310us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1787380387.428739:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 62 00000020:00080000:0.0:1787380387.428744:0:6525:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787380387.428833:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380387.428840:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69d49 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380387.428847:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867000 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380387.428851:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69d49 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380387.428859:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69d49 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380387.428870:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d6ec26f4b00) 00010000:00010000:2.0:1787380387.428873:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787380387.428877:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69d49 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380387.428883:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867000/0xcf3c46fdcad69d49 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380387.428896:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380387.428898:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380387.428899:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380387.434286:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380387.434385:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848581760 00000100:00100000:1.0:1787380387.434394:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848581760 00000100:00100000:1.0:1787380387.434609:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 248 00000100:00100000:1.0:1787380387.434620:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+26:12458:x1874203848581760:12345-192.168.206.30@tcp:58:lfs.0 00000040:00080000:1.0:1787380387.435060:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787380387.435289:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+26:12458:x1874203848581760:12345-192.168.206.30@tcp:58:lfs.0 Request processed in 671us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380387.435298:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 248 00000100:00100000:0.0:1787380387.468371:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380387.468393:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867496576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380387.468466:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380387.468511:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867496576 00000100:00100000:0.0:1787380387.468518:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867496576 00000100:00100000:0.0:1787380387.468571:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787380387.468580:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874203867496576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787380387.468600:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:0.0:1787380387.468640:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874203867496576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380387.468648:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787380387.468691:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867496576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380387.468889:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380387.468898:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867496704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380387.468935:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380387.468964:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867496704 00000100:00100000:2.0:1787380387.468968:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867496704 00000100:00100000:2.0:1787380387.469015:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787380387.469022:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867496704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787380387.469034:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3691950080 00000100:00100000:2.0:1787380387.469064:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867496704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380387.469070:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:2.0:1787380387.469099:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787380387.469122:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867496704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787380387.470085:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867496832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787380387.470138:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380387.470333:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867496832 00000100:00100000:3.0:1787380387.470340:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867496832 00000100:00100000:3.0:1787380387.470382:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787380387.470390:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867496832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787380387.470416:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1787380387.470465:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867496832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380387.470471:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787380387.471745:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867497088:0@lo:400:kworker.0 00000100:00100000:2.0:1787380387.471798:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380387.471854:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867497600:0@lo:400:kworker.0 00000100:00100000:2.0:1787380387.471875:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380387.471894:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787380387.471900:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867496960:0@lo:400:kworker.0 00000100:00100000:2.0:1787380387.471999:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380387.472023:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1874203867497472:0@lo:400:kworker.0 00000100:00100000:2.0:1787380387.472043:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380387.472060:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867497984:0@lo:400:kworker.0 00000100:00100000:2.0:1787380387.472078:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380387.472268:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867497344:0@lo:400:kworker.0 00000100:00100000:1.0:1787380387.472308:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380387.472324:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1874203867497856:0@lo:400:kworker.0 00000100:00100000:1.0:1787380387.472344:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380387.472373:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867496832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787380387.472388:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787380387.472394:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867497216:0@lo:400:kworker.0 00000100:00100000:1.0:1787380387.472414:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380387.472427:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867497728:0@lo:400:kworker.0 00000100:00100000:1.0:1787380387.472467:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380387.472495:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867497728 00000100:00100000:1.0:1787380387.472500:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867497728 00000100:00100000:0.0:1787380387.472784:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867496960 00000100:00100000:0.0:1787380387.472789:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867496960 00000100:00100000:0.0:1787380387.472844:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1787380387.472852:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3642:x1874203867496960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380387.478226:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787380387.478240:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867497728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380387.478329:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867497728:12345-0@lo:400:kworker.0 Request processed in 92us (5860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380387.478337:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787380387.478392:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867497728:0@lo:400:kworker.0 00000100:00100000:1.0:1787380387.478419:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867497088 00000100:00100000:1.0:1787380387.478424:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867497088 00000100:00100000:1.0:1787380387.479259:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867497600 00000100:00100000:1.0:1787380387.479266:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867497600 00000100:00100000:1.0:1787380387.479288:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867497472 00000100:00100000:1.0:1787380387.479291:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867497472 00000100:00100000:1.0:1787380387.479304:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867497984 00000100:00100000:1.0:1787380387.479306:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867497984 00000100:00100000:1.0:1787380387.479317:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867497856 00000100:00100000:1.0:1787380387.479320:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867497856 00000100:00100000:1.0:1787380387.479351:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867497216 00000100:00100000:1.0:1787380387.479354:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867497216 00000100:00100000:1.0:1787380387.479366:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787380387.479372:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867497088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380387.479488:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3642:x1874203867496960:12345-0@lo:400:kworker.0 Request processed in 6635us (7486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380387.479496:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1787380387.479552:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867497344 00000100:00100000:0.0:1787380387.479556:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867497344 00000100:00100000:0.0:1787380387.479582:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787380387.479589:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867497344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380387.479629:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867497344:12345-0@lo:400:kworker.0 Request processed in 40us (7320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380387.479636:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787380387.479677:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867497344:0@lo:400:kworker.0 00000100:00100000:0.0:1787380387.479716:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1787380387.479724:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867497600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380387.480032:0:10154:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787380387.480040:0:10154:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1787380387.480142:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1787380387.480150:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874203867497472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380387.480757:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867497088:12345-0@lo:400:kworker.0 Request processed in 1382us (8956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380387.480765:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1787380387.480842:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380387.480857:0:6523:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787380387.480864:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848581888 00000100:00100000:1.0:1787380387.480868:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848581888 00000100:00100000:1.0:1787380387.480885:0:6523:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787380387.480893:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787380387.480898:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867497984:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787380387.481006:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380387.481012:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787380387.481014:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380387.481041:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867496960:0@lo:400:kworker.0 00000100:00100000:1.0:1787380387.481106:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867497984:12345-0@lo:400:kworker.0 Request processed in 207us (9026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380387.481112:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1787380387.481125:0:6523:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787380387.481131:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787380387.481137:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874203867497856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380387.481281:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874203867497856:12345-0@lo:400:kworker.0 Request processed in 143us (8936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380387.481287:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1787380387.481298:0:6523:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787380387.481304:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787380387.481310:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867497216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380387.481340:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867497216:12345-0@lo:400:kworker.0 Request processed in 30us (8924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380387.481358:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1787380387.481369:0:6523:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787380387.481376:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 249 00000100:00100000:1.0:1787380387.481382:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+26:12461:x1874203848581888:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1787380387.481392:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380387.481409:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69d50 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0afdd expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.481880:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0c00/0xcf3c46fdcad69d57 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.481893:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0c00/0xcf3c46fdcad69d57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.481968:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0c00/0xcf3c46fdcad69d57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.481986:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69d5e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.481994:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69d5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.482001:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69d5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.482072:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0400/0xcf3c46fdcad69d65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.482082:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69c70 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af9e expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.482161:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0400/0xcf3c46fdcad69d65 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.482256:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69c70 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af9e expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.482269:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69c70 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af9e expref: 27 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380387.482282:0:6523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867498112:192.168.206.30@tcp:104: 00000100:00100000:1.0:1787380387.482347:0:6523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb4a0240 going to sleep for 11 seconds 00000100:00100000:1.0:1787380387.482394:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867497216:0@lo:400:kworker.0 00000100:00100000:1.0:1787380387.482406:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1874203867497856:0@lo:400:kworker.0 00000100:00100000:0.0:1787380387.485583:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867497600:12345-0@lo:400:kworker.0 Request processed in 5851us (13697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380387.485597:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1787380387.486071:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874203867497472:12345-0@lo:400:kworker.0 Request processed in 5920us (14023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380387.486079:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1787380387.486314:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380387.486357:0:6523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6523:1874203867498112:192.168.206.30@tcp:104: 00010000:00010000:1.0:1787380387.486378:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0400/0xcf3c46fdcad69d65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380387.487324:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1874203867497472:0@lo:400:kworker.0 00010000:00080000:2.0:1787380387.487342:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec20a7b80 x1874203867497984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380387.487359:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867497984:0@lo:400:kworker.0 00000100:00100000:2.0:1787380387.487373:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867497088:0@lo:400:kworker.0 00010000:00080000:2.0:1787380387.487384:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec20a4380 x1874203867497600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380387.487393:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867497600:0@lo:400:kworker.0 00000100:00100000:2.0:1787380387.487427:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848582144 00000100:00100000:2.0:1787380387.487434:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848582144 00000100:00100000:2.0:1787380387.487626:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 63 00000100:00100000:2.0:1787380387.487635:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+28:6167:x1874203848582144:12345-192.168.206.30@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787380387.487857:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+29:6167:x1874203848582144:12345-192.168.206.30@tcp:35:ldlm_bl.0 Request processed in 223us (1544us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787380387.487864:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 63 00000100:00100000:0.0:1787380387.490125:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380387.490289:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848582272 00000100:00100000:3.0:1787380387.490297:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848582272 00010000:00010000:3.0:1787380387.490341:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69c70 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af9e expref: 29 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380387.490379:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 106 00000100:00100000:3.0:1787380387.490387:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+29:2400:x1874203848582272:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380387.490399:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380387.490406:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69c70 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af9e expref: 29 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.490419:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69c70 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af9e expref: 29 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.490447:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69c70 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af9e expref: 29 pid: 6522 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.490608:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:3.0:1787380387.490614:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0400/0xcf3c46fdcad69d65 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.490624:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0400/0xcf3c46fdcad69d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.490631:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0400/0xcf3c46fdcad69d65 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380387.490657:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380387.490699:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+28:2400:x1874203848582272:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 313us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380387.490707:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 106 00010000:00010000:1.0:1787380387.491156:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0400/0xcf3c46fdcad69d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.491165:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0400/0xcf3c46fdcad69d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380387.491268:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787380387.491272:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787380387.491298:0:6523:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0400/0xcf3c46fdcad69d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.491311:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0400/0xcf3c46fdcad69d65 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.491321:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0c00/0xcf3c46fdcad69d57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.491327:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0c00/0xcf3c46fdcad69d57 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.491334:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0c00/0xcf3c46fdcad69d57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.491339:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df0c00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380387.491342:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0c00/0xcf3c46fdcad69d57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.491349:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0c00/0xcf3c46fdcad69d57 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.491358:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:1.0:1787380387.491361:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380387.491365:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0c00/0xcf3c46fdcad69d57 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.491370:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0c00/0xcf3c46fdcad69d57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.491380:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69d5e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.491386:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69d5e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.491398:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69d5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.491402:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1c00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380387.491405:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69d5e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.491411:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69d5e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.491419:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9d6fc4e52c00) 00010000:00010000:1.0:1787380387.491422:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380387.491425:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69d5e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.491431:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1c00/0xcf3c46fdcad69d5e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.491620:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad69d50 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afdd expref: 28 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.491635:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0400/0xcf3c46fdcad69d65 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afdd expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380387.491643:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:1.0:1787380387.491645:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787380387.491648:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df0400, rc 0) 00000100:00100000:1.0:1787380387.491678:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+27:12461:x1874203848581888:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 10296us (10836us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380387.491694:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 249 00010000:00010000:3.0:1787380387.917763:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380387.981271:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787380387.981292:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867498240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380387.981348:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380387.986971:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867498240 00000100:00100000:2.0:1787380387.986985:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867498240 00000100:00100000:2.0:1787380387.987044:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787380387.987054:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874203867498240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380387.987083:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923517440 avail 3691995136 00000100:00100000:2.0:1787380387.987154:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874203867498240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (5805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380387.987161:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787380387.987211:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867498240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380387.989306:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867498368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380387.989367:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380387.989423:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867498368 00000100:00100000:3.0:1787380387.989429:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867498368 00000100:00100000:3.0:1787380387.989466:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787380387.989474:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867498368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787380387.989492:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923517440 avail 3691995136 00000100:00100000:3.0:1787380387.989545:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed07450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867498368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380387.989552:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787380387.989786:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867498368:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787380388.005090:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380388.005127:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380388.005148:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380388.005171:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380388.005188:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380388.005215:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380388.005240:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380388.005274:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848582528 00000100:00100000:1.0:1787380388.005283:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848582528 00000100:00100000:1.0:1787380388.005333:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848583040 00000100:00100000:1.0:1787380388.005337:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848583040 00000100:00100000:1.0:1787380388.005351:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848582656 00000100:00100000:1.0:1787380388.005353:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848582656 00000100:00100000:1.0:1787380388.005365:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848583168 00000100:00100000:1.0:1787380388.005367:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848583168 00000100:00100000:1.0:1787380388.005381:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 325 00000100:00100000:1.0:1787380388.005389:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+27:2398:x1874203848582528:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380388.005455:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+27:2398:x1874203848582528:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 66us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380388.005462:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 325 00000100:00100000:1.0:1787380388.005478:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 326 00000100:00100000:1.0:1787380388.005484:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848583040:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380388.005512:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848583040:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 29us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380388.005518:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 326 00000100:00100000:1.0:1787380388.005541:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 327 00000100:00100000:1.0:1787380388.005547:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848582656:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380388.005571:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848582656:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380388.005577:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 327 00000100:00100000:0.0:1787380388.005700:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 328 00000100:00100000:0.0:1787380388.005710:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848583168:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380388.005736:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848583168:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 29us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380388.005742:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 328 00000100:00100000:2.0:1787380388.006034:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848582784 00000100:00100000:2.0:1787380388.006039:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848582784 00000100:00100000:2.0:1787380388.006082:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848582912 00000100:00100000:2.0:1787380388.006085:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848582912 00000100:00100000:2.0:1787380388.006110:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 124 00000100:00100000:2.0:1787380388.006118:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2398:x1874203848582784:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380388.006152:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2398:x1874203848582784:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 35us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380388.006158:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 124 00000100:00100000:2.0:1787380388.006173:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 125 00000100:00100000:2.0:1787380388.006179:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848582912:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380388.006203:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2398:x1874203848582912:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 25us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380388.006207:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 125 00000100:00100000:2.0:1787380388.006224:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848582400 00000100:00100000:2.0:1787380388.006227:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848582400 00000100:00100000:2.0:1787380388.006247:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 388 00000100:00100000:2.0:1787380388.006253:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2398:x1874203848582400:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380388.006275:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2398:x1874203848582400:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 22us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380388.006280:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 388 00000100:00080000:2.0:1787380388.006305:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787380388.006309:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787380388.006311:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1787380388.299016:0:14765:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787380388.299025:0:14765:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787380388.299058:0:14765:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787380388.299200:0:14765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1787380388.427991:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787380388.428001:0:13800:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787380388.428028:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787380388.428034:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787380388.428151:0:13800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17faa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1874203867498496:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787380388.428244:0:13800:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787380388.438653:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380388.438686:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848583296 00000100:00100000:0.0:1787380388.438696:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848583296 00000100:00100000:0.0:1787380388.438742:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 250 00000100:00100000:0.0:1787380388.438750:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+28:12473:x1874203848583296:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787380388.438795:0:6522:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787380388.438919:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+28:12473:x1874203848583296:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 170us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380388.438927:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 250 00000100:00100000:2.0:1787380388.439675:0:13800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17faa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13800:1874203867498496:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787380388.458677:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380388.459277:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848583552 00000100:00100000:0.0:1787380388.459287:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848583552 00000100:00100000:0.0:1787380388.459412:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 251 00000100:00100000:0.0:1787380388.459422:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+27:12473:x1874203848583552:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380388.459441:0:10154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380388.459461:0:10154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69d6c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0afe4 expref: -99 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380388.459560:0:10154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69d73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380388.459574:0:10154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69d73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380388.459585:0:10154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69d73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380388.459596:0:10154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787380388.460147:0:10154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69d6c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afe4 expref: 30 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380388.460165:0:10154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69d73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afe4 expref: 29 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380388.460187:0:10154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380388.460190:0:10154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380388.460193:0:10154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866800, rc 0) 00000100:00100000:0.0:1787380388.460329:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+29:12473:x1874203848583552:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 907us (1659us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787380388.460407:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 251 00000100:00100000:0.0:1787380388.476674:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380388.476833:0:14727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848583808 00000100:00100000:3.0:1787380388.476843:0:14727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848583808 00000100:00100000:3.0:1787380388.476903:0:14727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 252 00000100:00100000:3.0:1787380388.476913:0:14727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+29:12473:x1874203848583808:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787380388.476987:0:14727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69d81 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380388.477004:0:14727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69d81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380388.477015:0:14727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69d81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380388.477189:0:14727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69d81 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380388.477197:0:14727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69d81 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380388.477209:0:14727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69d81 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380388.477215:0:14727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89dc00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380388.477220:0:14727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69d81 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380388.477227:0:14727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69d81 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380388.477240:0:14727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:3.0:1787380388.477243:0:14727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787380388.477247:0:14727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69d81 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380388.477253:0:14727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69d81 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14727 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380388.477494:0:14727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+30:12473:x1874203848583808:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 580us (827us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1787380388.477502:0:14727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 252 00000040:00080000:2.0:1787380388.477749:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787380388.477755:0:13800:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787380388.478215:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787380388.478222:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787380388.487523:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380388.487610:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380388.488990:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848583936 00000100:00100000:0.0:1787380388.489002:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848583936 00000100:00100000:0.0:1787380388.489063:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:0.0:1787380388.489073:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+30:2399:x1874203848583936:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380388.489087:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380388.489110:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69d73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afe4 expref: 30 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380388.489127:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380388.489151:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380388.489198:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+29:2399:x1874203848583936:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 128us (2326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380388.489205:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:2.0:1787380388.493381:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848584192 00000100:00100000:2.0:1787380388.493395:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848584192 00000100:00100000:2.0:1787380388.495024:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 64 00000100:00100000:2.0:1787380388.495037:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+29:12473:x1874203848584192:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787380388.495227:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+30:12473:x1874203848584192:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 192us (7616us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787380388.495235:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 64 00010000:00010000:2.0:1787380388.940030:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380389.004888:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380389.010863:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867498624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787380389.010946:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380389.011189:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867498624 00000100:00100000:1.0:1787380389.011198:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867498624 00000100:00100000:1.0:1787380389.011241:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787380389.011250:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867498624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380389.011282:0:13003:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380389.011332:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867498624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380389.011339:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787380389.011479:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867498624:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787380389.966314:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787380390.095349:0:14817:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787380390.095358:0:14817:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787380390.095388:0:14817:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787380390.095394:0:14817:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787380390.289998:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380390.294665:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848584448 00000100:00100000:0.0:1787380390.294676:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848584448 00000100:00100000:0.0:1787380390.294745:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 253 00000100:00100000:0.0:1787380390.294755:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+30:12494:x1874203848584448:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1787380390.294789:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380390.294829:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69d88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0afeb expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380390.294922:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69d8f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380390.294936:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69d8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380390.294947:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69d8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380390.294958:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787380390.295051:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866800/0xcf3c46fdcad69d88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afeb expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380390.295067:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69d8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afeb expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380390.295076:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380390.295078:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787380390.295081:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867a00, rc 0) 00000100:00100000:0.0:1787380390.295138:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+32:12494:x1874203848584448:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 385us (5147us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1787380390.295593:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 253 00000100:00080000:1.0:1787380390.297309:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380390.314671:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380390.314735:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848584576 00000100:00100000:0.0:1787380390.314745:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848584576 00000100:00100000:0.0:1787380390.314832:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 254 00000100:00100000:0.0:1787380390.314842:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+32:12494:x1874203848584576:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:0.0:1787380390.314909:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69d9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380390.314926:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69d9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380390.314936:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69d9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380390.314969:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69d9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380390.314976:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69d9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380390.314982:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69d9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380390.314988:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380390.314992:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69d9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380390.314998:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69d9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380390.315009:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380390.315012:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787380390.315016:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69d9d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380390.315022:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad69d9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380390.315089:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+32:12494:x1874203848584576:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 248us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380390.315097:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 254 00000100:00100000:0.0:1787380390.397915:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380390.398015:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848584704 00000100:00100000:1.0:1787380390.398025:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848584704 00000100:00100000:1.0:1787380390.398094:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 81 00000100:00100000:1.0:1787380390.398105:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffcb18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2398:x1874203848584704:12345-192.168.206.30@tcp:101:cat.0 00010000:00010000:1.0:1787380390.398121:0:8871:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380390.398140:0:8871:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045ba5dcc/0xcf3c46fdcad69da4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0aff2 expref: -99 pid: 8871 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787380390.398162:0:8871:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a8942a3, atime: 0x6a8942a3, ctime: 0x6a8942a3, blocks: 0x8 00010000:00010000:1.0:1787380390.398192:0:8871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=400s v=(0 0) 00010000:00010000:1.0:1787380390.398197:0:8871:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380390.398205:0:8871:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045ba5dcc/0xcf3c46fdcad69da4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aff2 expref: 8 pid: 8871 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380390.398220:0:8871:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000045ba5dcc/0xcf3c46fdcad69da4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aff2 expref: 8 pid: 8871 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380390.398232:0:8871:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df1c00, rc 0) 00000100:00100000:1.0:1787380390.398297:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffcb18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2398:x1874203848584704:12345-192.168.206.30@tcp:101:cat.0 Request processed in 185us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380390.398304:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 81 00000100:00080000:2.0:1787380390.398978:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380390.402401:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380390.402639:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848584832 00000100:00100000:3.0:1787380390.402649:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848584832 00002000:00100000:3.0:1787380390.402694:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9d6fd17fad80 x1874203848584832/t0(0) o3->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:196/0 lens 488/0 e 0 to 0 dl 1787380401 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787380390.402723:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6fd17fad80 with x1874203848584832 ext(0->4095) 00002000:00010000:3.0:1787380390.402728:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d6fd17fad80 00000100:00100000:3.0:1787380390.402769:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:3.0:1787380390.402779:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2398:x1874203848584832:12345-192.168.206.30@tcp:3:cat.0 00000100:00100000:3.0:1787380390.402961:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+8:2398:x1874203848584832:12345-192.168.206.30@tcp:3:cat.0 Request processed in 183us (568us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787380390.402969:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 9 00002000:00100000:3.0:1787380390.402976:0:8440:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9d6fd17fad80 x1874203848584832/t0(0) o3->7da54272-8859-4cb3-ba98-d1d4e18c7c38@192.168.206.30@tcp:196/0 lens 488/4536 e 0 to 0 dl 1787380401 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787380390.402983:0:8440:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9d6fd17fad80 with x1874203848584832 ext(0->4095) 00002000:00010000:3.0:1787380390.402987:0:8440:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9d6fd17fad80 00010000:00010000:3.0:1787380390.992370:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787380391.245707:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787380391.563977:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787380391.563986:0:13800:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787380391.564006:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787380391.564013:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787380392.018988:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380392.589601:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867498752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380392.589676:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380392.589849:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867498752 00000100:00100000:0.0:1787380392.589856:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867498752 00000100:00100000:0.0:1787380392.589902:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787380392.589909:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874203867498752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787380392.589933:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1787380392.589968:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3641:x1874203867498752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380392.589975:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:0.0:1787380392.590011:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787380392.590042:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867498752:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1787380392.590975:0:9514:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:2.0:1787380392.591094:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787380392.591105:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867498880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380392.591252:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380392.591294:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867498880 00000100:00100000:2.0:1787380392.591299:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867498880 00000100:00100000:2.0:1787380392.591340:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787380392.591346:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867498880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787380392.591372:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380392.591408:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867498880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380392.591414:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:2.0:1787380392.591431:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787380392.591668:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380392.591678:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867499008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787380392.591709:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380392.592232:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867498880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380392.592292:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867499008 00000100:00100000:2.0:1787380392.592298:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867499008 00000100:00100000:2.0:1787380392.592327:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787380392.592334:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867499008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787380392.592358:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787380392.592398:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867499008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380392.592405:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787380392.592444:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867499008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380392.593071:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867499520:0@lo:400:kworker.0 00000100:00100000:3.0:1787380392.593106:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380392.593127:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867500032:0@lo:400:kworker.0 00000100:00100000:3.0:1787380392.593162:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380392.593183:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787380392.593188:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867499136:0@lo:400:kworker.0 00000100:00100000:3.0:1787380392.593216:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380392.593238:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867499648:0@lo:400:kworker.0 00000100:00100000:3.0:1787380392.593260:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380392.593287:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867500160:0@lo:400:kworker.0 00000100:00100000:3.0:1787380392.593309:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380392.593331:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867499264:0@lo:400:kworker.0 00000100:00100000:3.0:1787380392.593351:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380392.593366:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1874203867499776:0@lo:400:kworker.0 00000100:00100000:3.0:1787380392.593384:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380392.593399:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867500288:0@lo:400:kworker.0 00000100:00100000:3.0:1787380392.593418:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380392.593434:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787380392.593440:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867499392:0@lo:400:kworker.0 00000100:00100000:0.0:1787380392.593888:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867499520 00000100:00100000:0.0:1787380392.593895:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867499520 00000100:00100000:0.0:1787380392.593927:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787380392.593934:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867499520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380392.594011:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867500032 00000100:00100000:2.0:1787380392.594015:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867500032 00000100:00100000:2.0:1787380392.594050:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787380392.594057:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3639:x1874203867500032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380392.594159:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867499520:12345-0@lo:400:kworker.0 Request processed in 224us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380392.594166:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787380392.594187:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867499136 00000100:00100000:0.0:1787380392.594197:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867499136 00000100:00100000:0.0:1787380392.594221:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1787380392.594227:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867499136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380392.594256:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867499136:12345-0@lo:400:kworker.0 Request processed in 29us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380392.594262:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1787380392.594286:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867499648 00000100:00100000:0.0:1787380392.594290:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867499648 00000100:00100000:0.0:1787380392.594308:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867500160 00000100:00100000:0.0:1787380392.594310:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867500160 00000100:00100000:0.0:1787380392.594323:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867499264 00000100:00100000:0.0:1787380392.594326:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867499264 00000100:00100000:0.0:1787380392.594336:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867499776 00000100:00100000:0.0:1787380392.594338:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867499776 00000100:00100000:0.0:1787380392.594347:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867500288 00000100:00100000:0.0:1787380392.594349:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867500288 00000100:00100000:0.0:1787380392.594361:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1787380392.594367:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867499648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380392.594395:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867499648:12345-0@lo:400:kworker.0 Request processed in 29us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380392.594401:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1787380392.594412:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1787380392.594418:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867500160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380392.594444:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867500160:12345-0@lo:400:kworker.0 Request processed in 26us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380392.594449:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1787380392.594471:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1787380392.594476:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867499264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380392.594522:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867499264:12345-0@lo:400:kworker.0 Request processed in 45us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380392.594528:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1787380392.594547:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1787380392.594552:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874203867499776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380392.594575:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874203867499776:12345-0@lo:400:kworker.0 Request processed in 23us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380392.594580:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1787380392.594589:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787380392.594594:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874203867500288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380392.594615:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874203867500288:12345-0@lo:400:kworker.0 Request processed in 22us (1197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380392.594621:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1787380392.594661:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867499136:0@lo:400:kworker.0 00000100:00100000:0.0:1787380392.594673:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867499648:0@lo:400:kworker.0 00000100:00100000:0.0:1787380392.594682:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867500160:0@lo:400:kworker.0 00000100:00100000:0.0:1787380392.594690:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867499520:0@lo:400:kworker.0 00000001:00080000:0.0:1787380392.594762:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00000001:00080000:0.0:1787380392.594768:0:8429:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000100:00100000:2.0:1787380392.594930:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867500032:12345-0@lo:400:kworker.0 Request processed in 873us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380392.594938:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787380392.594971:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867500032:0@lo:400:kworker.0 00000100:00080000:2.0:1787380392.594990:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787380392.594993:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380392.595003:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787380392.601868:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1787380392.601899:0:6500:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9d6feb45de40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787380392.601904:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ffc93b800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9d6feb45dc00 00000020:00080000:1.0:1787380392.601907:0:6500:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9d6ffc93bd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9d6ec3e0da00 00000020:00080000:1.0:1787380392.601919:0:6500:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:0.0:1787380392.601972:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1000/0xcf3c46fdcad69d1f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380392.601983:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1000/0xcf3c46fdcad69d1f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380392.602002:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1000/0xcf3c46fdcad69d1f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380392.602008:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380392.602012:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1000/0xcf3c46fdcad69d1f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380392.602020:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1000/0xcf3c46fdcad69d1f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380392.602035:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9d6ec26f4b00) 00010000:00010000:0.0:1787380392.602038:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380392.602042:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1000/0xcf3c46fdcad69d1f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380392.602048:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1000/0xcf3c46fdcad69d1f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787380392.602077:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787380392.602133:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1787380392.602258:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380392.602303:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867499904:0@lo:400:kworker.0 00000100:00100000:3.0:1787380392.602347:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380392.602395:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867499264:0@lo:400:kworker.0 00010000:00080000:3.0:1787380392.602410:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec44bc700 x1874203867499776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380392.602419:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1874203867499776:0@lo:400:kworker.0 00010000:00080000:3.0:1787380392.602429:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc3b65500 x1874203867500288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380392.602436:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867500288:0@lo:400:kworker.0 00000100:00100000:1.0:1787380392.602621:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867499904 00000100:00100000:1.0:1787380392.602627:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867499904 00000100:00100000:1.0:1787380392.602694:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787380392.602702:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867499904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380392.602761:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867499904:12345-0@lo:400:kworker.0 Request processed in 59us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380392.602768:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787380392.602853:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867499392 00000100:00100000:0.0:1787380392.602858:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867499392 00000100:00100000:0.0:1787380392.602887:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1787380392.602894:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867499392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380392.602929:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867499392:12345-0@lo:400:kworker.0 Request processed in 36us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380392.602935:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00080000:3.0:1787380392.602987:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380392.603012:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867499392:0@lo:400:kworker.0 00000100:00100000:3.0:1787380392.603023:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867499904:0@lo:400:kworker.0 00010000:00010000:2.0:1787380393.039890:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380393.107684:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867500416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380393.107742:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380393.107827:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867500416 00000100:00100000:3.0:1787380393.107835:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867500416 00000100:00100000:3.0:1787380393.107873:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787380393.107880:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867500416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787380393.107905:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787380393.107943:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867500416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380393.107949:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787380393.108000:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867500416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380393.115639:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380393.115659:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867500544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380393.115726:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380393.115787:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867500544 00000100:00100000:0.0:1787380393.115794:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867500544 00000100:00100000:0.0:1787380393.115866:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787380393.115875:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867500544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380393.115894:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1787380393.115933:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867500544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380393.115940:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787380393.115989:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:0.0:1787380393.115994:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6ec44a9f80, transno 4294967324 00000004:00080000:0.0:1787380393.116003:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967326 committed transno 4294967326 00000100:00100000:0.0:1787380393.116025:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867500544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380393.139228:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380393.139261:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380393.139324:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848585216 00000100:00100000:2.0:1787380393.139333:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848585216 00000100:00100000:3.0:1787380393.139371:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380393.139394:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380393.139411:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380393.139430:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380393.139452:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00080000:3.0:1787380393.139468:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787380393.139479:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848585472 00000100:00100000:3.0:1787380393.139483:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848585472 00000100:00100000:3.0:1787380393.139540:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848585344 00000100:00100000:3.0:1787380393.139544:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848585344 00000100:00100000:2.0:1787380393.139564:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848585728 00000100:00100000:3.0:1787380393.139566:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 128 00000100:00100000:2.0:1787380393.139568:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848585728 00000100:00100000:3.0:1787380393.139574:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848585472:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380393.139580:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848585088 00000100:00100000:2.0:1787380393.139582:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848585088 00000100:00100000:3.0:1787380393.139637:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848585472:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 63us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380393.139650:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 128 00000100:00100000:3.0:1787380393.139674:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 129 00000100:00100000:3.0:1787380393.139680:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2399:x1874203848585344:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380393.139706:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2399:x1874203848585344:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 26us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380393.139712:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 129 00000100:00100000:3.0:1787380393.139729:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848585600 00000100:00100000:3.0:1787380393.139733:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848585600 00000100:00100000:2.0:1787380393.139955:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 335 00000100:00100000:3.0:1787380393.140044:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 336 00000100:00100000:3.0:1787380393.140051:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2399:x1874203848585728:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380393.140079:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2399:x1874203848585728:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 28us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380393.140084:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 336 00000100:00100000:3.0:1787380393.140098:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 337 00000100:00100000:3.0:1787380393.140103:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:2399:x1874203848585088:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380393.140127:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:2399:x1874203848585088:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 24us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380393.140132:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 337 00000100:00100000:2.0:1787380393.140216:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848585216:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380393.140244:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2399:x1874203848585216:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 34us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380393.140250:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 335 00000100:00100000:2.0:1787380393.140265:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 338 00000100:00100000:2.0:1787380393.140271:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2399:x1874203848585600:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380393.140291:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2399:x1874203848585600:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 20us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380393.140296:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 338 00000100:00080000:2.0:1787380393.140906:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380393.140911:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787380393.140913:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787380393.140915:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787380393.144554:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848584960 00000100:00100000:0.0:1787380393.144569:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848584960 00000100:00100000:0.0:1787380393.144628:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 390 00000100:00100000:0.0:1787380393.144638:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2399:x1874203848584960:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380393.144715:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2399:x1874203848584960:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 79us (5495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380393.144723:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 390 00010000:00010000:3.0:1787380394.059952:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380394.125886:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380394.125916:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867500672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787380394.125981:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380394.126098:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867500672 00000100:00100000:1.0:1787380394.126105:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867500672 00000100:00100000:1.0:1787380394.126156:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787380394.126163:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867500672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380394.126192:0:13003:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380394.126233:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867500672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380394.126239:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787380394.126392:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867500672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787380395.056834:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380395.056970:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848585856 00000100:00100000:2.0:1787380395.056979:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848585856 00000100:00100000:2.0:1787380395.057050:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 255 00000100:00100000:2.0:1787380395.057062:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:12139:x1874203848585856:12345-192.168.206.30@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787380395.057172:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:12139:x1874203848585856:12345-192.168.206.30@tcp:60:lhsmtool_posix.0 Request processed in 112us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380395.057180:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 255 00000100:00080000:3.0:1787380395.057439:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380395.070339:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380395.070446:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848585984 00000100:00100000:0.0:1787380395.070455:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848585984 00000100:00100000:0.0:1787380395.070529:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 256 00000100:00100000:0.0:1787380395.070539:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:12139:x1874203848585984:12345-192.168.206.30@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787380395.070646:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:12139:x1874203848585984:12345-192.168.206.30@tcp:60:lhsmtool_posix.0 Request processed in 109us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380395.070671:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 256 00000100:00080000:3.0:1787380395.071442:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787380395.080894:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380395.081594:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848586240 00000100:00100000:2.0:1787380395.081605:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848586240 00000100:00100000:2.0:1787380395.081661:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 65 00000100:00100000:2.0:1787380395.081671:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:12139:x1874203848586240:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787380395.081920:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:12139:x1874203848586240:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 249us (1032us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787380395.081929:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 65 00010000:00010000:2.0:1787380395.086659:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380395.441874:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380395.442767:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848586368 00000100:00100000:3.0:1787380395.442777:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848586368 00000100:00100000:3.0:1787380395.442902:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 257 00000100:00100000:3.0:1787380395.442913:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:12951:x1874203848586368:12345-192.168.206.30@tcp:101:lsof.0 00010000:00010000:3.0:1787380395.442931:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380395.442949:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69dab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0aff9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.443008:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69db2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.443021:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69db2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.443032:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69db2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787380395.443073:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787380395.443077:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787380395.443097:0:6522:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69db2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.443121:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89d000/0xcf3c46fdcad69dab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aff9 expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.443139:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69db2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aff9 expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380395.443147:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec26f4200) 00010000:00010000:3.0:1787380395.443150:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787380395.443166:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89dc00, rc 0) 00000100:00100000:3.0:1787380395.443225:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:12951:x1874203848586368:12345-192.168.206.30@tcp:101:lsof.0 Request processed in 313us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380395.443232:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 257 00000100:00080000:2.0:1787380395.443860:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787380396.109007:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380397.131899:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380397.708272:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867500800:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787380397.708341:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380397.708484:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867500800 00000100:00100000:2.0:1787380397.708492:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867500800 00000100:00100000:2.0:1787380397.708543:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787380397.708554:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867500800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787380397.708579:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380397.708618:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867500800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380397.708624:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1787380397.708645:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787380397.708875:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867500800:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787380397.708994:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380397.709003:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867500928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380397.709034:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380397.710867:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867501056:0@lo:400:kworker.0 00000100:00100000:1.0:1787380397.710939:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380397.710993:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867501056 00000100:00100000:1.0:1787380397.711000:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867501056 00000100:00100000:1.0:1787380397.711039:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1787380397.711048:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867501056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380397.711091:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3639:x1874203867501056:12345-0@lo:400:kworker.0 Request processed in 44us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380397.711098:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1787380397.711134:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867501056:0@lo:400:kworker.0 00000100:00100000:1.0:1787380397.711161:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380397.711167:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867501184:0@lo:400:kworker.0 00000100:00100000:1.0:1787380397.711188:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380397.711221:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867501184 00000100:00100000:1.0:1787380397.711225:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867501184 00000100:00100000:1.0:1787380397.711251:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1787380397.711256:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867501184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380397.711284:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867501184:12345-0@lo:400:kworker.0 Request processed in 29us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380397.711290:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1787380397.711312:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867501184:0@lo:400:kworker.0 00000100:00100000:1.0:1787380397.711347:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867501568:0@lo:400:kworker.0 00000100:00100000:1.0:1787380397.711364:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380397.711411:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380397.711417:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867501696:0@lo:400:kworker.0 00000100:00100000:1.0:1787380397.711439:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380397.711496:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867502080:0@lo:400:kworker.0 00000100:00100000:1.0:1787380397.711518:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380397.711547:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380397.711552:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867502208:0@lo:400:kworker.0 00000100:00100000:1.0:1787380397.711569:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380397.711583:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867501568 00000100:00100000:1.0:1787380397.711586:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867501568 00000100:00100000:1.0:1787380397.711607:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867501696 00000100:00100000:1.0:1787380397.711609:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867501696 00000100:00100000:1.0:1787380397.711618:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867502080 00000100:00100000:1.0:1787380397.711620:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867502080 00000100:00100000:1.0:1787380397.711629:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867502208 00000100:00100000:1.0:1787380397.711631:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867502208 00000100:00100000:1.0:1787380397.711642:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1787380397.711658:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867501568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380397.711693:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867501568:12345-0@lo:400:kworker.0 Request processed in 47us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380397.711700:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1787380397.711712:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1787380397.711717:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867501696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380397.711754:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867501696:12345-0@lo:400:kworker.0 Request processed in 36us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380397.711760:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1787380397.711771:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1787380397.711777:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867502080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380397.711799:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1874203867502080:12345-0@lo:400:kworker.0 Request processed in 23us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380397.711804:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1787380397.711841:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1787380397.711847:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867502208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380397.711870:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867502208:12345-0@lo:400:kworker.0 Request processed in 24us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380397.711876:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00080000:1.0:1787380397.711889:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787380397.711892:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787380397.711906:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3d79180 x1874203867502208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380397.711917:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867502208:0@lo:400:kworker.0 00000100:00100000:1.0:1787380397.711926:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3639:1874203867502080:0@lo:400:kworker.0 00010000:00080000:1.0:1787380397.711945:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3f8c380 x1874203867501696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380397.711952:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867501696:0@lo:400:kworker.0 00000100:00100000:1.0:1787380397.711960:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867501568:0@lo:400:kworker.0 00000100:00100000:0.0:1787380397.713466:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867501440:0@lo:400:kworker.0 00000100:00100000:0.0:1787380397.713531:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380397.713592:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867501312:0@lo:400:kworker.0 00000100:00100000:3.0:1787380397.713621:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380397.713658:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867501824:0@lo:400:kworker.0 00000100:00100000:3.0:1787380397.713679:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380397.713695:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867502336:0@lo:400:kworker.0 00000100:00100000:3.0:1787380397.713713:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380397.713757:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867501824 00000100:00100000:3.0:1787380397.713764:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867501824 00000100:00100000:3.0:1787380397.713824:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867502336 00000100:00100000:3.0:1787380397.713827:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867502336 00000100:00100000:3.0:1787380397.713855:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787380397.713874:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867501824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380397.713930:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867501824:12345-0@lo:400:kworker.0 Request processed in 68us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380397.713937:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787380397.713973:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787380397.713979:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867502336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380397.714009:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867502336:12345-0@lo:400:kworker.0 Request processed in 30us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380397.714015:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1787380397.714040:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787380397.714044:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380397.714053:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867501312 00000100:00100000:3.0:1787380397.714056:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867501312 00000100:00100000:3.0:1787380397.714078:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1787380397.714084:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867501312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380397.714113:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867501312:12345-0@lo:400:kworker.0 Request processed in 29us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380397.714119:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1787380397.714159:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867501312:0@lo:400:kworker.0 00000100:00100000:3.0:1787380397.714171:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867501824:0@lo:400:kworker.0 00000100:00100000:3.0:1787380397.714178:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1787380397.714183:0:3641:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1787380397.714202:0:3641:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6fc3b64700, transno 4294967311 00000100:00100000:3.0:1787380397.714210:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867502336:0@lo:400:kworker.0 00000100:00100000:3.0:1787380397.722170:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380397.722196:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867502464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380397.722261:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380397.722366:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867502464 00000100:00100000:1.0:1787380397.722374:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867502464 00000100:00100000:1.0:1787380397.722778:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787380397.722788:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867502464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380397.722830:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1787380397.722878:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867502464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380397.722886:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787380397.723130:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867502464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380397.726911:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867501952:0@lo:400:kworker.0 00000100:00100000:0.0:1787380397.726973:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380397.727033:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867501952 00000100:00100000:0.0:1787380397.727041:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867501952 00000100:00100000:0.0:1787380397.727096:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787380397.727104:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867501952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380397.727156:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867501952:12345-0@lo:400:kworker.0 Request processed in 53us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380397.727163:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:0.0:1787380397.727183:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380397.727214:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867501952:0@lo:400:kworker.0 00000001:00080000:3.0:1787380397.728137:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1787380397.728171:0:6500:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1787380397.731119:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1787380397.731139:0:6553:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1787380397.733331:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867501440 00000100:00100000:1.0:1787380397.733344:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867501440 00000100:00100000:2.0:1787380397.733371:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867500928 00000100:00100000:2.0:1787380397.733377:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867500928 00000100:00100000:1.0:1787380397.733423:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787380397.733431:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867501440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380397.733517:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867501440:12345-0@lo:400:kworker.0 Request processed in 86us (19985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380397.733524:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787380397.733605:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867501440:0@lo:400:kworker.0 00000100:00100000:2.0:1787380397.739658:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787380397.739673:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867500928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787380397.739738:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787380397.739839:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867500928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 169us (30803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380397.739847:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787380397.739955:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867500928:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787380398.156123:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380398.220058:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867502592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787380398.220126:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380398.220483:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867502592 00000100:00100000:3.0:1787380398.220491:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867502592 00000100:00100000:3.0:1787380398.220542:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787380398.220551:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867502592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787380398.220577:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787380398.220618:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867502592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380398.220625:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787380398.220760:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867502592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787380398.220777:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380398.220784:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867502720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380398.220848:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380398.221214:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867502720 00000100:00100000:3.0:1787380398.221219:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867502720 00000100:00100000:3.0:1787380398.221255:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787380398.221263:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867502720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787380398.221275:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787380398.221328:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867502720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380398.221334:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787380398.221466:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867502720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380398.240058:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380398.240101:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380398.240134:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848586496 00000100:00100000:0.0:1787380398.240134:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380398.240145:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848586496 00000100:00100000:0.0:1787380398.240160:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380398.240180:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380398.240203:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380398.240205:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 392 00000100:00100000:2.0:1787380398.240216:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2400:x1874203848586496:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380398.240244:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380398.240297:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2400:x1874203848586496:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 70us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380398.240305:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 392 00000100:00100000:3.0:1787380398.240710:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848587008 00000100:00100000:3.0:1787380398.240716:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848587008 00000100:00100000:3.0:1787380398.240776:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848586880 00000100:00100000:3.0:1787380398.240780:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848586880 00000100:00100000:3.0:1787380398.240801:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 133 00000100:00100000:3.0:1787380398.240833:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848587008:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380398.240871:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848587008:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 63us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380398.240878:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 133 00000100:00100000:3.0:1787380398.240905:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 134 00000100:00100000:3.0:1787380398.240911:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2400:x1874203848586880:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380398.240937:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2400:x1874203848586880:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 27us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380398.240943:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 134 00000100:00100000:3.0:1787380398.240963:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848586752 00000100:00100000:3.0:1787380398.240966:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848586752 00000100:00100000:3.0:1787380398.240989:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848587264 00000100:00100000:3.0:1787380398.240992:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848587264 00000100:00100000:3.0:1787380398.241003:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848586624 00000100:00100000:3.0:1787380398.241005:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848586624 00000100:00100000:3.0:1787380398.241015:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848587136 00000100:00100000:3.0:1787380398.241017:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848587136 00000100:00100000:3.0:1787380398.241028:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 345 00000100:00100000:3.0:1787380398.241034:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848586752:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380398.241061:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2400:x1874203848586752:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 28us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380398.241068:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 345 00000100:00100000:3.0:1787380398.241080:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 346 00000100:00100000:3.0:1787380398.241086:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848587264:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380398.241108:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2400:x1874203848587264:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 22us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380398.241120:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 346 00000100:00100000:3.0:1787380398.241132:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 347 00000100:00100000:3.0:1787380398.241138:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:2400:x1874203848586624:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380398.241165:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:2400:x1874203848586624:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 28us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380398.241177:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 347 00000100:00100000:3.0:1787380398.241191:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 348 00000100:00100000:3.0:1787380398.241197:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2400:x1874203848587136:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380398.241221:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2400:x1874203848587136:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 24us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380398.241226:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 348 00000100:00080000:0.0:1787380398.243297:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787380398.243306:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787380398.243309:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787380398.243312:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1787380399.097255:0:15015:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 02:33:18 (1787380398) 00010000:00010000:3.0:1787380399.180154:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380399.251636:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867502848:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787380399.251700:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380399.251781:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867502848 00000100:00100000:1.0:1787380399.251789:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867502848 00000100:00100000:1.0:1787380399.251850:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787380399.251860:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867502848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380399.251893:0:13003:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1787380399.251935:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867502848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380399.251943:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787380399.252001:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867502848:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787380400.211180:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380401.232835:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787380401.484805:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1787380401.807064:0:13800:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787380401.807074:0:13800:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787380401.807172:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1787380401.807179:0:13800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787380402.253280:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380402.828007:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867502976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787380402.828007:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867503104:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380402.828299:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867503360:0@lo:400:kworker.0 00000100:00100000:0.0:1787380402.828385:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867503232:0@lo:400:kworker.0 00000100:00100000:3.0:1787380402.833659:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380402.833754:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867503488:0@lo:400:kworker.0 00000100:00100000:3.0:1787380402.833797:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380402.833856:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380402.833946:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867503488 00000100:00100000:0.0:1787380402.833954:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867503488 00000100:00100000:0.0:1787380402.834000:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787380402.834009:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867503488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380402.834052:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867504000:0@lo:400:kworker.0 00000100:00100000:0.0:1787380402.834065:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867503488:12345-0@lo:400:kworker.0 Request processed in 56us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380402.834085:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787380402.834087:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380402.834112:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867504512:0@lo:400:kworker.0 00000100:00100000:0.0:1787380402.834134:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867503232 00000100:00100000:3.0:1787380402.834139:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380402.834140:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867503232 00000100:00100000:0.0:1787380402.834173:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1787380402.834180:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3640:x1874203867503232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380402.834185:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867503488:0@lo:400:kworker.0 00000100:00100000:3.0:1787380402.834204:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380402.834213:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867504896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380402.834220:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3640:x1874203867503232:12345-0@lo:400:kworker.0 Request processed in 38us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380402.834228:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1787380402.834257:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380402.834258:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867502976 00000100:00100000:0.0:1787380402.834263:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867502976 00000100:00100000:3.0:1787380402.834300:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867504000 00000100:00100000:0.0:1787380402.834302:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867504896 00000100:00100000:3.0:1787380402.834305:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867504000 00000100:00100000:0.0:1787380402.834307:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867504896 00000100:00100000:0.0:1787380402.834326:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787380402.834335:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867502976:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380402.834352:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867504512 00002000:00000024:0.0:1787380402.834356:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380402.834357:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867504512 00000100:00100000:3.0:1787380402.834382:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1787380402.834392:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867504000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380402.834411:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867502976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380402.834419:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787380402.834437:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867504000:12345-0@lo:400:kworker.0 Request processed in 45us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380402.834437:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787380402.834451:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1787380402.834451:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867504896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787380402.834465:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380402.834477:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1787380402.834485:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867504512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380402.834677:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867504896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 230us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380402.834684:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:0.0:1787380402.834715:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787380402.834719:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787380402.834746:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867503232:0@lo:400:kworker.0 00000100:00100000:0.0:1787380402.834754:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867503744:0@lo:400:kworker.0 00000100:00100000:3.0:1787380402.834773:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867504512:12345-0@lo:400:kworker.0 Request processed in 287us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380402.834782:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1787380402.834788:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380402.834828:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867504256:0@lo:400:kworker.0 00000100:00100000:0.0:1787380402.834851:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380402.834868:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867504768:0@lo:400:kworker.0 00000100:00100000:0.0:1787380402.834888:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380402.835031:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380402.835042:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787380402.835052:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867503616:0@lo:400:kworker.0 00000100:00100000:2.0:1787380402.835059:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867503872:0@lo:400:kworker.0 00000100:00100000:0.0:1787380402.835085:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380402.835111:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867504128:0@lo:400:kworker.0 00000100:00100000:2.0:1787380402.835121:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380402.835139:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380402.835143:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867504384:0@lo:400:kworker.0 00000100:00100000:0.0:1787380402.835160:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867504640:0@lo:400:kworker.0 00000100:00100000:2.0:1787380402.835175:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380402.835189:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380402.835221:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867504256 00000100:00100000:0.0:1787380402.835237:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867504768 00000100:00100000:0.0:1787380402.835242:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867504768 00000100:00100000:0.0:1787380402.835267:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867504128 00000100:00100000:0.0:1787380402.835270:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867504128 00000100:00100000:3.0:1787380402.835283:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867503360 00000100:00100000:3.0:1787380402.835289:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867503360 00000100:00100000:0.0:1787380402.835290:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867504640 00000100:00100000:0.0:1787380402.835295:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867504640 00000100:00100000:3.0:1787380402.835314:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867503616 00000100:00100000:3.0:1787380402.835318:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867503616 00000100:00100000:0.0:1787380402.835319:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787380402.835329:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867504768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380402.835338:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867503872 00000100:00100000:3.0:1787380402.835342:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867503872 00000100:00100000:3.0:1787380402.835356:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867504384 00000100:00100000:3.0:1787380402.835358:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867504384 00000100:00100000:0.0:1787380402.835376:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867504768:12345-0@lo:400:kworker.0 Request processed in 47us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380402.835377:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1787380402.835387:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867503360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380402.835388:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787380402.835408:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787380402.835415:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867504128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380402.835432:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867503360:12345-0@lo:400:kworker.0 Request processed in 45us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380402.835439:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1787380402.835453:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867504128:12345-0@lo:400:kworker.0 Request processed in 37us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380402.835458:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1787380402.835464:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787380402.835469:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867503616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380402.835500:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867503616:12345-0@lo:400:kworker.0 Request processed in 34us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380402.835512:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1787380402.835527:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1787380402.835533:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867503872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380402.835576:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867504256 00000100:00100000:2.0:1787380402.835605:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787380402.835611:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867504640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380402.836218:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787380402.836228:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867504256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380402.838982:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867504640:12345-0@lo:400:kworker.0 Request processed in 3364us (3786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380402.839009:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787380402.839088:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867503360:0@lo:400:kworker.0 00000100:00100000:2.0:1787380402.839229:0:14727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787380402.839242:0:14727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867504384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380402.839298:0:14727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867504384:12345-0@lo:400:kworker.0 Request processed in 60us (4123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380402.839305:0:14727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1787380402.839351:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867504384:0@lo:400:kworker.0 00000100:00080000:2.0:1787380402.839423:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380402.839429:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787380402.839458:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867504896:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787380402.839473:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc30da300 x1874203867504000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380402.839482:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867504000:0@lo:400:kworker.0 00010000:00080000:2.0:1787380402.839493:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc30d8000 x1874203867504512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380402.839502:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867504512:0@lo:400:kworker.0 00000100:00100000:2.0:1787380402.839517:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867502976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380402.839562:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867503744 00000100:00100000:2.0:1787380402.839568:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867503744 00000100:00100000:2.0:1787380402.839601:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787380402.839608:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867503744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380402.839657:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867503744:12345-0@lo:400:kworker.0 Request processed in 49us (4869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380402.839664:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787380402.839714:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867503616:0@lo:400:kworker.0 00000100:00100000:2.0:1787380402.839727:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867504128:0@lo:400:kworker.0 00000100:00100000:2.0:1787380402.839736:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867504640:0@lo:400:kworker.0 00000100:00100000:2.0:1787380402.839746:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867503744:0@lo:400:kworker.0 00000100:00100000:2.0:1787380402.839756:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867504768:0@lo:400:kworker.0 00000100:00100000:3.0:1787380402.841177:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867503872:12345-0@lo:400:kworker.0 Request processed in 5566us (5979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380402.841189:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1787380402.841269:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867503872:0@lo:400:kworker.0 00000100:00100000:1.0:1787380402.843198:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380402.843364:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867504256:12345-0@lo:400:kworker.0 Request processed in 7135us (8508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380402.843375:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787380402.843468:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867503104 00000100:00100000:2.0:1787380402.843476:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867503104 00000100:00100000:2.0:1787380402.843786:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787380402.843796:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867503104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787380402.843854:0:13003:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1787380402.843897:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867503104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380402.843917:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787380402.843985:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867503104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787380402.844837:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867504256:0@lo:400:kworker.0 00000100:00100000:0.0:1787380402.964745:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380402.964844:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848587520 00000100:00100000:2.0:1787380402.964855:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848587520 00000100:00100000:2.0:1787380402.964931:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00100000:2.0:1787380402.964941:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+18:13174:x1874203848587520:12345-192.168.206.30@tcp:35:umount.0 00000100:00100000:2.0:1787380402.965179:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:13174:x1874203848587520:12345-192.168.206.30@tcp:35:umount.0 Request processed in 239us (443us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787380402.965201:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 66 00000100:00080000:0.0:1787380402.965331:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380402.984499:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380402.984629:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848587776 00000100:00100000:3.0:1787380402.984638:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848587776 00000100:00100000:3.0:1787380402.984706:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 67 00000100:00100000:3.0:1787380402.984715:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+19:13174:x1874203848587776:12345-192.168.206.30@tcp:35:umount.0 00000100:00100000:3.0:1787380402.985036:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+20:13174:x1874203848587776:12345-192.168.206.30@tcp:35:umount.0 Request processed in 321us (545us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1787380402.985045:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 67 00000100:00100000:1.0:1787380402.989178:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380402.989905:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848588032 00000100:00100000:3.0:1787380402.989916:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848588032 00000100:00100000:3.0:1787380402.989987:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 68 00000100:00100000:3.0:1787380402.989995:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc7be1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+20:13174:x1874203848588032:12345-192.168.206.30@tcp:35:umount.0 00000100:00100000:3.0:1787380402.990192:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc7be1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7da54272-8859-4cb3-ba98-d1d4e18c7c38+21:13174:x1874203848588032:12345-192.168.206.30@tcp:35:umount.0 Request processed in 197us (1022us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1787380402.990200:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 68 00000100:00100000:0.0:1787380403.002151:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380403.002247:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848588288 00000100:00100000:2.0:1787380403.002257:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848588288 00000100:00100000:2.0:1787380403.002310:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 69 00000100:00100000:2.0:1787380403.002320:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+21:13174:x1874203848588288:12345-192.168.206.30@tcp:35:umount.0 00000100:00100000:2.0:1787380403.002601:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:13174:x1874203848588288:12345-192.168.206.30@tcp:35:umount.0 Request processed in 282us (459us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787380403.002609:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 69 00000100:00100000:1.0:1787380403.012535:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380403.012574:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380403.012623:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380403.012757:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848588416 00000100:00100000:0.0:1787380403.012767:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848588416 00000100:00100000:0.0:1787380403.012853:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848588544 00000100:00100000:0.0:1787380403.012856:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848588544 00000100:00100000:0.0:1787380403.012869:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848588672 00000100:00100000:0.0:1787380403.012871:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848588672 00000100:00100000:0.0:1787380403.012885:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:0.0:1787380403.012894:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2facc94b-d95a-46d6-aa1a-c4299279749f+15:2399:x1874203848588416:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380403.012908:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380403.012944:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5fdae00/0xcf3c46fdcad68d0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab4c expref: 15 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380403.012961:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380403.013006:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d78000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2facc94b-d95a-46d6-aa1a-c4299279749f+14:2399:x1874203848588416:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 113us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380403.013013:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:0.0:1787380403.013039:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00100000:0.0:1787380403.013044:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2facc94b-d95a-46d6-aa1a-c4299279749f+13:2399:x1874203848588544:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380403.013052:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380403.013061:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5fda800/0xcf3c46fdcad68ccc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab0d expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380403.013069:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380403.013087:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2facc94b-d95a-46d6-aa1a-c4299279749f+12:2399:x1874203848588544:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 43us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380403.013093:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00100000:0.0:1787380403.013104:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:0.0:1787380403.013110:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2facc94b-d95a-46d6-aa1a-c4299279749f+11:2400:x1874203848588672:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380403.013117:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380403.013132:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5d47600/0xcf3c46fdcad68fa4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac25 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380403.013140:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380403.013156:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2400:x1874203848588672:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 47us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380403.013162:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:1.0:1787380403.019864:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380403.020001:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848588800 00000100:00100000:2.0:1787380403.020011:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848588800 00000100:00100000:2.0:1787380403.020094:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 82 00000100:00100000:2.0:1787380403.020104:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2396:x1874203848588800:12345-192.168.206.30@tcp:9:umount.0 00000020:00000080:2.0:1787380403.020132:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad690a7 00000100:00080000:2.0:1787380403.020140:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9d6fd2f4d800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787380403.020190:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1787380403.020335:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+2:2396:x1874203848588800:12345-192.168.206.30@tcp:9:umount.0 Request processed in 233us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380403.020343:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 82 00000100:00080000:0.0:1787380403.020481:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787380403.020780:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380403.026061:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380403.026132:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848589184 00000100:00100000:2.0:1787380403.026140:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848589184 00000100:00100000:2.0:1787380403.026201:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 83 00000100:00100000:2.0:1787380403.026211:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+7:2396:x1874203848589184:12345-192.168.206.30@tcp:9:umount.0 00000020:00000080:2.0:1787380403.026237:0:12152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad69316 00000020:00010000:2.0:1787380403.026243:0:12152:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d6fff73a800: total 0 00000100:00080000:2.0:1787380403.026247:0:12152:0:(import.c:65:import_set_state_nolock()) ffff9d6fff739000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787380403.026302:0:12152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:2.0:1787380403.026458:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2396:x1874203848589184:12345-192.168.206.30@tcp:9:umount.0 Request processed in 232us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380403.026467:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 83 00000020:00010000:1.0:1787380403.026761:0:6510:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d6fff73a800: total 0 00010000:00010000:1.0:1787380403.026795:0:6510:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d6fff73a800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787380403.026868:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045ba5dcc/0xcf3c46fdcad69da4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aff2 expref: 4 pid: 8871 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380403.026896:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a28fe2da/0xcf3c46fdcad696d5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae0f expref: 3 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380403.026909:0:6510:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d6fff73a800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787380403.026919:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380403.026921:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380403.026923:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787380403.027155:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787380403.036275:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380403.036412:0:14727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848590208 00000100:00100000:2.0:1787380403.036421:0:14727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848590208 00000100:00100000:2.0:1787380403.036798:0:14727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 258 00000100:00100000:2.0:1787380403.036852:0:14727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+22:2396:x1874203848590208:12345-192.168.206.30@tcp:39:umount.0 00000020:00000080:2.0:1787380403.036882:0:14727:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68cda 00000020:00010000:2.0:1787380403.036896:0:14727:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d6fcff59800: total 0 00000100:00080000:2.0:1787380403.036900:0:14727:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2754000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787380403.036920:0:14727:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1787380403.037070:0:14727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7da54272-8859-4cb3-ba98-d1d4e18c7c38+21:2396:x1874203848590208:12345-192.168.206.30@tcp:39:umount.0 Request processed in 263us (803us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1787380403.037078:0:14727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 258 00000020:00010000:0.0:1787380403.037144:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d6fcff59800: total 0 00010000:00010000:0.0:1787380403.037209:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d6fcff59800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787380403.037241:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380403.037245:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787380403.037252:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad69d8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afeb expref: 20 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380403.037273:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:0.0:1787380403.037276:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787380403.037280:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867200/0xcf3c46fdcad6907d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac4f expref: 19 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380403.037292:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:0.0:1787380403.037294:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787380403.037298:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad69a47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0af0b expref: 18 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380403.037310:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec26f4200) 00010000:00010000:0.0:1787380403.037313:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787380403.037332:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867600/0xcf3c46fdcad6973e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae2b expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380403.037348:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6ec25a8300) 00010000:00010000:0.0:1787380403.037350:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380403.037353:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47800/0xcf3c46fdcad69022 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac3a expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380403.037369:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:0.0:1787380403.037372:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380403.037375:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867400/0xcf3c46fdcad69696 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adfa expref: 15 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380403.037386:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380403.037388:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787380403.037392:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad69c85 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afa5 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380403.037403:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:0.0:1787380403.037405:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787380403.037408:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad696c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae08 expref: 13 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380403.037419:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9d6ec25aae00) 00010000:00010000:0.0:1787380403.037421:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787380403.037424:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fc165ae00/0xcf3c46fdcad69378 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ad28 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380403.037439:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9d6ec3030900) 00010000:00010000:0.0:1787380403.037459:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787380403.037464:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0600/0xcf3c46fdcad6975a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ae32 expref: 11 pid: 10154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380403.037482:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d6ec241b500) 00010000:00010000:0.0:1787380403.037484:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787380403.037488:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb000/0xcf3c46fdcad69006 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac33 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380403.037519:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9d6ec26f4500) 00010000:00010000:0.0:1787380403.037522:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787380403.037526:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0400/0xcf3c46fdcad69d65 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0afdd expref: 9 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380403.037538:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9d6ec241bd00) 00010000:00010000:0.0:1787380403.037541:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787380403.037544:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fd0d0ec00/0xcf3c46fdcad695b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0adc2 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380403.037716:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d6fcff59800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1787380403.037733:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380403.037735:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380403.037737:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380403.053173:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380403.053421:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848590336 00000100:00100000:2.0:1787380403.053432:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848590336 00000100:00100000:2.0:1787380403.053514:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 259 00000100:00100000:2.0:1787380403.053526:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+5:2396:x1874203848590336:12345-192.168.206.30@tcp:39:umount.0 00000100:00080000:0.0:1787380403.053683:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:2.0:1787380403.053775:0:6523:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68ce1 00000100:00080000:2.0:1787380403.053793:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9d6ff5ca9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787380403.053888:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787380403.054047:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7da54272-8859-4cb3-ba98-d1d4e18c7c38+3:2396:x1874203848590336:12345-192.168.206.30@tcp:39:umount.0 Request processed in 522us (881us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787380403.054055:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 259 00010000:00010000:1.0:1787380403.056164:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380403.276066:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380403.342358:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867505024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380403.342425:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380403.342718:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867505024 00000100:00100000:2.0:1787380403.342726:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867505024 00000100:00100000:2.0:1787380403.342789:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787380403.342798:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867505024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380403.342854:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787380403.342900:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867505024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380403.342907:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787380403.343042:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867505024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380403.343461:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867505152:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380403.343501:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380403.343570:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867505152 00000100:00100000:2.0:1787380403.343575:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867505152 00000100:00100000:2.0:1787380403.343612:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787380403.343619:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867505152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787380403.343631:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1787380403.347637:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867505152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4007us (4124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380403.347644:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867505152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787380403.347655:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787380403.357405:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380403.357499:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380403.364202:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848590464 00000100:00100000:3.0:1787380403.364217:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848590464 00000100:00080000:1.0:1787380403.364675:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380403.364741:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848590592 00000100:00100000:3.0:1787380403.364746:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848590592 00000100:00100000:3.0:1787380403.364790:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 355 00000100:00100000:3.0:1787380403.364800:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2398:x1874203848590464:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380403.364907:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2398:x1874203848590464:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 108us (7510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380403.364916:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 355 00000100:00100000:3.0:1787380403.364941:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 356 00000100:00100000:3.0:1787380403.364948:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848590592:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380403.364974:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2398:x1874203848590592:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 27us (7475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380403.364981:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 356 00000100:00080000:0.0:1787380403.365196:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787380404.303453:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380404.366618:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380404.366639:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867505280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787380404.366720:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380404.367269:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867505280 00000100:00100000:3.0:1787380404.367277:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867505280 00000100:00100000:3.0:1787380404.367338:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787380404.367356:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867505280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787380404.367387:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1787380404.367443:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867505280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380404.367451:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787380404.367601:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867505280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787380404.864364:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380404.864495:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848590720 00000100:00100000:0.0:1787380404.864504:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848590720 00000100:00100000:0.0:1787380404.864562:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:0.0:1787380404.864655:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2398:x1874203848590720:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380404.864671:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380404.864699:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc165b200/0xcf3c46fdcad68ddd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab61 expref: 10 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380404.864716:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380404.864768:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2facc94b-d95a-46d6-aa1a-c4299279749f+9:2398:x1874203848590720:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 117us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380404.870253:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380404.870302:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380404.870394:0:10339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848590976 00000100:00100000:2.0:1787380404.870403:0:10339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848590976 00000100:00100000:2.0:1787380404.870464:0:10339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848590848 00000100:00100000:2.0:1787380404.870467:0:10339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848590848 00000100:00100000:2.0:1787380404.870485:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:2.0:1787380404.870495:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd691ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2facc94b-d95a-46d6-aa1a-c4299279749f+11:2398:x1874203848590976:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380404.870509:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380404.870526:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9aa00/0xcf3c46fdcad68f9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ac1e expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380404.870542:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380404.870604:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd691ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2facc94b-d95a-46d6-aa1a-c4299279749f+10:2398:x1874203848590976:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 110us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380404.870628:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:2.0:1787380404.870645:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 26 00000100:00100000:2.0:1787380404.870651:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2facc94b-d95a-46d6-aa1a-c4299279749f+9:2398:x1874203848590848:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380404.870659:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380404.870669:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7866e00/0xcf3c46fdcad68de4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab92 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380404.870692:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380404.870712:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2facc94b-d95a-46d6-aa1a-c4299279749f+8:2398:x1874203848590848:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 61us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380404.870719:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 26 00000100:00100000:0.0:1787380404.873653:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:1.0:1787380404.880139:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380404.880220:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848591232 00000100:00100000:2.0:1787380404.880230:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848591232 00000100:00100000:2.0:1787380404.880288:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 260 00000100:00100000:2.0:1787380404.880298:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+6:2396:x1874203848591232:12345-192.168.206.30@tcp:39:umount.0 00000020:00000080:2.0:1787380404.880334:0:6523:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68df2 00000020:00010000:2.0:1787380404.880344:0:6523:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d6ec3768800: total 0 00000100:00080000:2.0:1787380404.880348:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9d6ec376e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787380404.880380:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:1.0:1787380404.881110:0:8451:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d6ec3768800: total 0 00010000:00010000:1.0:1787380404.881128:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380404.881174:0:8451:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d6ec3768800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787380404.881252:0:8451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec26f4200) 00010000:00010000:1.0:1787380404.881256:0:8451:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787380404.881266:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89dc00/0xcf3c46fdcad69db2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0aff9 expref: 6 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380404.881292:0:8451:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d6ec3768800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787380404.881304:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380404.881306:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380404.881308:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380404.884122:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bd549a2a-de1a-4b9c-be02-339b2f6be909+3:2396:x1874203848591232:12345-192.168.206.30@tcp:39:umount.0 Request processed in 3815us (3980us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1787380404.884136:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 260 00000100:00100000:3.0:1787380404.911884:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380404.912526:0:10154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848591360 00000100:00100000:1.0:1787380404.912536:0:10154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848591360 00000100:00100000:1.0:1787380404.912646:0:10154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 261 00000100:00100000:1.0:1787380404.912655:0:10154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+5:2396:x1874203848591360:12345-192.168.206.30@tcp:39:umount.0 00000020:00000080:1.0:1787380404.912703:0:10154:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68df9 00000100:00080000:1.0:1787380404.912714:0:10154:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2622800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787380404.912742:0:10154:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1787380404.912893:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380404.913151:0:10154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bd549a2a-de1a-4b9c-be02-339b2f6be909+3:2396:x1874203848591360:12345-192.168.206.30@tcp:39:umount.0 Request processed in 495us (1273us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787380404.913159:0:10154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 261 00000100:00100000:1.0:1787380404.953903:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380404.954006:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848591616 00000100:00100000:2.0:1787380404.954015:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848591616 00000100:00100000:2.0:1787380404.954085:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 394 00000100:00100000:2.0:1787380404.954094:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+7:2396:x1874203848591616:12345-192.168.206.30@tcp:251:umount.0 00000020:00000080:2.0:1787380404.954154:0:6513:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68cb7 00000020:00010000:2.0:1787380404.954161:0:6513:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d6ec376f000: total 0 00000100:00080000:2.0:1787380404.954165:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9d6ec376b000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787380404.954241:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2facc94b-d95a-46d6-aa1a-c4299279749f+3:2396:x1874203848591616:12345-192.168.206.30@tcp:251:umount.0 Request processed in 148us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380404.954249:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 394 00000020:00010000:3.0:1787380404.954917:0:6509:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d6ec376f000: total 0 00010000:00010000:3.0:1787380404.955600:0:6509:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d6ec376f000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787380404.955723:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad68d12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0ab53 expref: 2 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380404.955742:0:6509:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d6ec376f000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787380404.955756:0:6509:0:(genops.c:906:class_export_put()) final put ffff9d6ec376f000/2facc94b-d95a-46d6-aa1a-c4299279749f 00010000:00010000:3.0:1787380404.955775:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380404.955790:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380404.955793:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787380404.955929:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec376f000/2facc94b-d95a-46d6-aa1a-c4299279749f for MGS 00000020:00000080:2.0:1787380404.955962:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec376b000 for MGS 00010000:00010000:1.0:1787380405.325606:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380406.354577:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787380406.786089:0:15210:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787380406.809911:0:15210:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787380406.810299:0:15210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46000/0xcf3c46fdcad68d6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.810313:0:15210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46000/0xcf3c46fdcad68d6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.810321:0:15210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46000/0xcf3c46fdcad68d6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.810328:0:15210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46000/0xcf3c46fdcad68d6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.810353:0:15210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787380406.810358:0:15210:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787380406.810381:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787380406.810385:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787380406.810390:0:15210:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787380406.810411:0:15210:0:(import.c:65:import_set_state_nolock()) ffff9d6fc473c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787380406.810704:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380406.810711:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46000/0xcf3c46fdcad68d6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.810719:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46000 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:2.0:1787380406.810723:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46000/0xcf3c46fdcad68d6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.810731:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46000/0xcf3c46fdcad68d6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3c46fdcad68d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380406.810738:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46000/0xcf3c46fdcad68d6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3c46fdcad68d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380406.810743:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787380406.810746:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787380406.810748:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787380406.810774:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46000/0xcf3c46fdcad68d6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.810781:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787380406.810831:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46000/0xcf3c46fdcad68d6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.810850:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46000/0xcf3c46fdcad68d6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68d74 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.810861:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380406.810862:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380406.810864:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380406.811595:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867505536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380406.811660:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380406.811741:0:10339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867505536 00000100:00100000:3.0:1787380406.811748:0:10339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867505536 00000100:00100000:3.0:1787380406.814379:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787380406.814397:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3641:x1874203867505536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787380406.814414:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380406.814456:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5fdac00/0xcf3c46fdcad68d74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad68d6d expref: 24 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.814473:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380406.814536:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:3641:x1874203867505536:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (2876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380406.814544:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787380406.814601:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867505536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380406.814883:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec20a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874203867505408:0@lo:39:umount.0 00000100:00100000:1.0:1787380406.814923:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380406.815149:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867505408 00000100:00100000:1.0:1787380406.815155:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867505408 00000100:00100000:1.0:1787380406.815237:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787380406.815245:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874203867505408:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787380406.815268:0:6522:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad688ce 00000100:00080000:1.0:1787380406.815275:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9d6ff4e7e000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787380406.815328:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3638:x1874203867505408:12345-0@lo:39:umount.0 Request processed in 84us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380406.815334:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:1.0:1787380406.815342:0:6522:0:(genops.c:906:class_export_put()) final put ffff9d6ff4e7c800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787380406.815435:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787380406.816178:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6fc473c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787380406.816198:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec20a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874203867505408:0@lo:39:umount.0 00000020:00000080:0.0:1787380406.816230:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff4e7c800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1787380406.816277:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ff4e7e000 for lustre-MDT0000 00000100:00080000:3.0:1787380406.816342:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787380406.816346:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787380406.816350:0:15210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787380406.817555:0:15210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdb800/0xcf3c46fdcad68d7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.817570:0:15210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdb800/0xcf3c46fdcad68d7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68d82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.817578:0:15210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdb800/0xcf3c46fdcad68d7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68d82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.817586:0:15210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdb800/0xcf3c46fdcad68d7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68d82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.817654:0:15210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380406.817661:0:15210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68c71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.817668:0:15210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68c71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68c78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.817702:0:15210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68c71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68c78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.817709:0:15210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68c71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68c78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.817785:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787380406.817792:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdb800/0xcf3c46fdcad68d7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68d82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.817799:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdb800 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:2.0:1787380406.817802:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdb800/0xcf3c46fdcad68d7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68d82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.817866:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdb800/0xcf3c46fdcad68d7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3c46fdcad68d82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380406.817874:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdb800/0xcf3c46fdcad68d7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3c46fdcad68d82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380406.817879:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787380406.817882:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1787380406.817910:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdb800/0xcf3c46fdcad68d7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68d82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.817916:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787380406.818021:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867505664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380406.818078:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380406.818153:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdb800/0xcf3c46fdcad68d7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68d82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.818171:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdb800/0xcf3c46fdcad68d7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68d82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.818184:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380406.818187:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68c78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.818193:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c800 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:2.0:1787380406.818196:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68c78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.818203:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68c71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3c46fdcad68c78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380406.818210:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68c71 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3c46fdcad68c78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380406.818215:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787380406.818217:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1787380406.818230:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68c71 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68c78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.818236:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787380406.818251:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68c71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68c78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.818258:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380406.818260:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380406.818262:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380406.818276:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380406.818288:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867505792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787380406.818314:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380406.818414:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867505664 00000100:00100000:1.0:1787380406.818520:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867505664 00000100:00100000:1.0:1787380406.818566:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867505792 00000100:00100000:1.0:1787380406.818570:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867505792 00000100:00100000:1.0:1787380406.818591:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787380406.818600:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+24:3642:x1874203867505664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380406.818611:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380406.818625:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7866c00/0xcf3c46fdcad68d82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad68d7b expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380406.818636:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380406.818701:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787380406.818710:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1e31f5e-7395-4c34-a795-7159073dc2a2+23:3640:x1874203867505792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787380406.818718:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380406.818728:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffb89d600/0xcf3c46fdcad68c78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad68c71 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.818737:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380406.818765:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:3640:x1874203867505792:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380406.818771:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787380406.818803:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867505792:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787380406.818919:0:15210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787380406.818925:0:15210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c800/0xcf3c46fdcad68c71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68c78 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380406.818935:0:15210:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787380406.819011:0:15210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68fd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68fdc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.819018:0:15210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68fd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68fdc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.819024:0:15210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68fd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68fdc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.819029:0:15210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68fd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68fdc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.819041:0:15210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380406.819046:0:15210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165a200/0xcf3c46fdcad6882d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68834 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.819053:0:15210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165a200/0xcf3c46fdcad6882d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68834 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.819067:0:15210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165a200/0xcf3c46fdcad6882d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68834 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.819073:0:15210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9d6fc165a200/0xcf3c46fdcad6882d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68834 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.819083:0:15210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787380406.819086:0:15210:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1787380406.819089:0:15210:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787380406.819120:0:15210:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787380406.819124:0:15210:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787380406.819128:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787380406.819133:0:15210:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1787380406.819138:0:15210:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9d6ec30f9800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787380406.819143:0:15210:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9d6ec2380800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787380406.819147:0:15210:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9d6fc479c800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787380406.819150:0:15210:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9d6ff4e7e800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1787380406.819157:0:15210:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9d6ec3768800 bd549a2a-de1a-4b9c-be02-339b2f6be909 192.168.206.30@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787380406.819163:0:15210:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9d6fcff59800 7da54272-8859-4cb3-ba98-d1d4e18c7c38 192.168.206.30@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:3.0:1787380406.819167:0:15210:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9d6feb4519c0) has exports, disconnecting them 00000020:00080000:3.0:1787380406.819171:0:15210:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d6ec30f9800), last request at 1787380402 00000020:00000080:3.0:1787380406.819177:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68bde 00000100:00080000:3.0:1787380406.819191:0:15210:0:(import.c:65:import_set_state_nolock()) ffff9d6ec30fd800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787380406.819226:0:15210:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d6ec30f9800): rc 0 00000020:00000080:3.0:1787380406.819228:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6ec30f9800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787380406.819247:0:15210:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d6ec2380800), last request at 1787380402 00000020:00000080:3.0:1787380406.819250:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68ab8 00000100:00080000:3.0:1787380406.819256:0:15210:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2381000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787380406.819267:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec30f9800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787380406.819303:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec30fd800 for lustre-MDT0000 00000020:00080000:3.0:1787380406.819318:0:15210:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d6ec2380800): rc 0 00000020:00000080:3.0:1787380406.819320:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6ec2380800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1787380406.819327:0:15210:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d6fc479c800), last request at 1787380182 00000020:00000080:3.0:1787380406.819330:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad689b5 00000100:00080000:3.0:1787380406.819334:0:15210:0:(import.c:65:import_set_state_nolock()) ffff9d6fc479d800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787380406.819341:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec2380800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787380406.819363:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec2381000 for lustre-MDT0000 00000020:00080000:3.0:1787380406.819374:0:15210:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d6fc479c800): rc 0 00000020:00000080:3.0:1787380406.819376:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6fc479c800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1787380406.819383:0:15210:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9d6ff4e7e800), last request at 1787380182 00000020:00000080:3.0:1787380406.819386:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68976 00000100:00080000:3.0:1787380406.819389:0:15210:0:(import.c:65:import_set_state_nolock()) ffff9d6ffc7f4800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787380406.819396:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc479c800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787380406.819416:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6fc479d800 for lustre-MDT0000 00010000:00010000:2.0:1787380406.819567:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787380406.819573:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68fd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68fdc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.819580:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165be00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:2.0:1787380406.819583:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68fd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68fdc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.819590:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68fd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3c46fdcad68fdc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380406.819598:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68fd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3c46fdcad68fdc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380406.819603:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787380406.819612:0:8451:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787380406.819614:0:8451:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787380406.819637:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68fd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68fdc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.819643:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787380406.819660:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68fd5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68fdc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.819666:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fc165be00/0xcf3c46fdcad68fd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68fdc expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.819686:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380406.819689:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fc165a200/0xcf3c46fdcad6882d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68834 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.819694:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165a200 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:2.0:1787380406.819697:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165a200/0xcf3c46fdcad6882d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68834 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.819703:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fc165a200/0xcf3c46fdcad6882d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3c46fdcad68834 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380406.819708:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165a200/0xcf3c46fdcad6882d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3c46fdcad68834 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380406.819712:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787380406.819714:0:8451:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787380406.819716:0:8451:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787380406.819726:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fc165a200/0xcf3c46fdcad6882d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68834 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.819742:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000001:00000004:3.0:1787380406.819777:0:15210:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:3.0:1787380406.819795:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867506048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380406.819859:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380406.819905:0:10339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867506048 00000100:00100000:3.0:1787380406.819910:0:10339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867506048 00000100:00100000:3.0:1787380406.819949:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787380406.819957:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1e31f5e-7395-4c34-a795-7159073dc2a2+22:3641:x1874203867506048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787380406.819966:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380406.819984:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9ba00/0xcf3c46fdcad68834 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad6882d expref: 22 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.819995:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380406.820025:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:3641:x1874203867506048:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380406.820031:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787380406.820070:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867506048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787380406.820926:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380406.820933:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787380406.821440:0:15210:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d6ff4e7e800): rc 0 00000004:00000080:3.0:1787380406.821449:0:15210:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb3a807a83ae0 00000100:00080000:3.0:1787380406.821472:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787380406.821476:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1787380406.822418:0:15210:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787380406.822444:0:15210:0:(import.c:65:import_set_state_nolock()) ffff9d6fcfe16000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000001:00100000:3.0:1787380406.823252:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bd549a2a-de1a-4b9c-be02-339b2f6be909 00000001:00080000:3.0:1787380406.823263:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:3.0:1787380406.823267:0:6500:0:(genops.c:906:class_export_put()) final put ffff9d6ec3768800/bd549a2a-de1a-4b9c-be02-339b2f6be909 00000001:00100000:3.0:1787380406.823278:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000001:00080000:3.0:1787380406.823282:0:6500:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1787380406.823290:0:6500:0:(genops.c:906:class_export_put()) final put ffff9d6fcff59800/7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000020:00000080:3.0:1787380406.823307:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec3768800/bd549a2a-de1a-4b9c-be02-339b2f6be909 for lustre-MDT0000 00000020:00000080:3.0:1787380406.823341:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fcff59800/7da54272-8859-4cb3-ba98-d1d4e18c7c38 for lustre-MDT0000 00000020:00000080:3.0:1787380406.823365:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec376e000 for lustre-MDT0000 00000020:00000080:3.0:1787380406.823369:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec2754000 for lustre-MDT0000 00000100:00100000:3.0:1787380406.823875:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867505920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380406.824022:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380406.824078:0:10339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867505920 00000100:00100000:3.0:1787380406.824085:0:10339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867505920 00000100:00100000:3.0:1787380406.824127:0:10339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787380406.824136:0:10339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1e31f5e-7395-4c34-a795-7159073dc2a2+21:3640:x1874203867505920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787380406.824150:0:10339:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380406.824168:0:10339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5d46600/0xcf3c46fdcad68fdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad68fd5 expref: 21 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380406.824181:0:10339:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380406.824214:0:10339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1e31f5e-7395-4c34-a795-7159073dc2a2+20:3640:x1874203867505920:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380406.824220:0:10339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787380406.824269:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:3640:1874203867505920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380406.825519:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:3642:x1874203867505664:12345-0@lo:103:ldlm_bl.0 Request processed in 6914us (7434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380406.825530:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787380406.825605:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867506176:0@lo:39:umount.0 00000100:00100000:1.0:1787380406.825652:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380406.825909:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867505664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380406.826071:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867506176 00000100:00100000:1.0:1787380406.826078:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867506176 00000100:00100000:1.0:1787380406.826115:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787380406.826123:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874203867506176:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787380406.826168:0:13003:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68a10 00000100:00080000:1.0:1787380406.826177:0:13003:0:(import.c:65:import_set_state_nolock()) ffff9d6ff5e62800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787380406.826196:0:13003:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787380406.826318:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3638:x1874203867506176:12345-0@lo:39:umount.0 Request processed in 195us (665us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787380406.826324:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00010000:00010000:1.0:1787380406.826342:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787380406.826361:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6fcfe16000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787380406.826368:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867506176:0@lo:39:umount.0 00000100:00080000:1.0:1787380406.826524:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787380406.826527:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 3 00000004:00080000:1.0:1787380406.826542:0:15210:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787380406.826600:0:15210:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787380406.826617:0:15210:0:(import.c:65:import_set_state_nolock()) ffff9d6ec20bd000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787380406.826630:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787380406.826633:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1787380406.826641:0:15210:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787380406.826715:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867506304:0@lo:9:umount.0 00000100:00100000:1.0:1787380406.826746:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787380406.826771:0:15210:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787380406.826781:0:15210:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3769800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787380406.826797:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867506432:0@lo:9:umount.0 00000100:00100000:1.0:1787380406.826841:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1787380406.826886:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9d6feb4519c0) has no exports 00000100:00100000:1.0:1787380406.826915:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867506304 00000100:00100000:1.0:1787380406.826919:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867506304 00000100:00100000:1.0:1787380406.826961:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867506432 00000100:00100000:1.0:1787380406.826973:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867506432 00000100:00100000:1.0:1787380406.826994:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787380406.827000:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874203867506304:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787380406.827013:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68b60 00000100:00080000:1.0:1787380406.827018:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9d6fff5a1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787380406.827046:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:1.0:1787380406.827128:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3638:x1874203867506304:12345-0@lo:9:umount.0 Request processed in 128us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380406.827134:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787380406.827145:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787380406.827150:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1874203867506432:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787380406.827160:0:8436:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68ca2 00000100:00080000:1.0:1787380406.827165:0:8436:0:(import.c:65:import_set_state_nolock()) ffff9d6ec36c5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787380406.827184:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1787380406.827248:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3638:x1874203867506432:12345-0@lo:9:umount.0 Request processed in 97us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380406.827255:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1787380406.827285:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3769800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787380406.827289:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787380406.827291:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787380406.827294:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867506432:0@lo:9:umount.0 00000100:00080000:1.0:1787380406.827303:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec20bd000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787380406.827310:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787380406.827311:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787380406.827314:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867506304:0@lo:9:umount.0 00010000:00010000:1.0:1787380406.827331:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380406.827350:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787380406.827545:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380406.827549:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787380406.828114:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165a200/0xcf3c46fdcad6882d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68834 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.828126:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fc165a200/0xcf3c46fdcad6882d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68834 expref: -99 pid: 6498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380406.828148:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380406.828150:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380406.828152:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787380406.833384:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9d6feb4519c0) has no exports 00000020:00000080:3.0:1787380406.904118:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68888 00000020:00000080:3.0:1787380406.904131:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6ff4c80000/lustre-QMT0000_UUID 00000020:01000000:3.0:1787380406.904181:0:15210:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787380406.904334:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787380406.904343:0:15210:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787380406.904348:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9d6ff4c64d40) has no exports 00000020:00000080:1.0:1787380406.904542:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff4c80000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787380406.905093:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68881 00000020:00000080:2.0:1787380406.905099:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6ff4c54800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787380406.905131:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff4c54800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787380406.905162:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787380406.905170:0:15210:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787380406.905173:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6ff4c52000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787380406.905175:0:15210:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff4c52000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787380406.905183:0:15210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1787380407.372054:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380407.948127:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787380407.949574:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867506688:0@lo:400:kworker.0 00000100:00100000:1.0:1787380407.949676:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380407.949730:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380407.949736:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867506816:0@lo:400:kworker.0 00000100:00100000:1.0:1787380407.949766:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380407.949941:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867506944:0@lo:400:kworker.0 00000100:00100000:3.0:1787380407.949976:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380407.950004:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867506560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380407.950136:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380407.950160:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380407.950169:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867507072:0@lo:400:kworker.0 00000100:00100000:3.0:1787380407.950200:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380407.950291:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867507456:0@lo:400:kworker.0 00000100:00100000:0.0:1787380407.950296:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867506688 00000100:00100000:0.0:1787380407.950303:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867506688 00000100:00100000:3.0:1787380407.950341:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380407.950342:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867507328:0@lo:400:kworker.0 00000100:00100000:0.0:1787380407.950350:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1787380407.950359:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:3639:x1874203867506688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380407.950362:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380407.950369:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867507584:0@lo:400:kworker.0 00000100:00100000:3.0:1787380407.950390:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380407.950417:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867506944 00000100:00100000:0.0:1787380407.950418:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:3639:x1874203867506688:12345-0@lo:400:kworker.0 Request processed in 59us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380407.950422:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867506944 00000100:00100000:0.0:1787380407.950429:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1787380407.950442:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380407.950448:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867507072 00000100:00100000:3.0:1787380407.950452:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867507072 00000100:00100000:3.0:1787380407.950464:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867507456 00000100:00100000:3.0:1787380407.950467:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867507456 00000100:00100000:0.0:1787380407.950478:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867506816 00000100:00100000:3.0:1787380407.950479:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867507584 00000100:00100000:3.0:1787380407.950484:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867507584 00000100:00100000:0.0:1787380407.950485:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867506816 00000100:00100000:0.0:1787380407.950513:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867506560 00000100:00100000:3.0:1787380407.950514:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1787380407.950518:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867506560 00000100:00100000:2.0:1787380407.950532:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867507840:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380407.950533:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787380407.950540:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1874203867506816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380407.950544:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874203867507584:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787380407.950550:0:6526:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787380407.950558:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380407.950583:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787380407.950584:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1874203867506816:12345-0@lo:400:kworker.0 Request processed in 43us (816us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787380407.950590:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867507200:0@lo:400:kworker.0 00000100:00100000:0.0:1787380407.950591:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787380407.950599:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874203867507584:12345-0@lo:400:kworker.0 Request processed in 59us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380407.950607:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1787380407.950616:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380407.950631:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867507200 00000100:00100000:2.0:1787380407.950631:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867507712:0@lo:400:kworker.0 00000100:00100000:3.0:1787380407.950635:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867507200 00000100:00100000:3.0:1787380407.950660:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1787380407.950676:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380407.950686:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867507200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380407.950710:0:14727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787380407.950716:0:14727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1874203867506944:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787380407.950722:0:14727:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787380407.950729:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867507200:12345-0@lo:400:kworker.0 Request processed in 45us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380407.950736:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1787380407.950751:0:14727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1874203867506944:12345-0@lo:400:kworker.0 Request processed in 33us (773us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787380407.950757:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787380407.950763:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1874203867507072:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787380407.950767:0:6521:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787380407.950771:0:14727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787380407.950794:0:14727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787380407.950797:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3641:x1874203867507072:12345-0@lo:400:kworker.0 Request processed in 31us (595us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787380407.950801:0:14727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1874203867507456:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787380407.950826:0:14727:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787380407.950839:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787380407.950857:0:14727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3641:x1874203867507456:12345-0@lo:400:kworker.0 Request processed in 54us (515us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787380407.950864:0:14727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00010000:00080000:3.0:1787380407.950880:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc30dad80 x1874203867507584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380407.950890:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867507328 00000100:00100000:3.0:1787380407.950894:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867507584:0@lo:400:kworker.0 00000100:00100000:2.0:1787380407.950897:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867507328 00000100:00080000:3.0:1787380407.950907:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787380407.950913:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2625000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787380407.950917:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1787380407.950991:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867507712 00000100:00100000:2.0:1787380407.950995:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867507712 00000100:00100000:1.0:1787380407.951000:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787380407.951006:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3641:x1874203867506560:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1787380407.951012:0:13003:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787380407.951017:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787380407.951023:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867507328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380407.951052:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867507328:12345-0@lo:400:kworker.0 Request processed in 29us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380407.951058:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787380407.951070:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787380407.951076:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867507712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380407.951102:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867507712:12345-0@lo:400:kworker.0 Request processed in 26us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380407.951108:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787380407.951134:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867507840 00000100:00100000:2.0:1787380407.951138:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867507840 00000100:00100000:2.0:1787380407.951159:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787380407.951166:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867507840:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787380407.951184:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787380407.951346:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867507840:12345-0@lo:13:osp-pre-1-1.0 Request processed in 179us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380407.951352:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00010000:00080000:2.0:1787380407.951449:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc30dbb80 x1874203867507200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380407.951460:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867507200:0@lo:400:kworker.0 00000100:00080000:0.0:1787380407.951461:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380407.951465:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787380407.951468:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787380407.951535:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1787380407.951536:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867507712:0@lo:400:kworker.0 00000100:00080000:0.0:1787380407.951538:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9d6ffc5bf000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787380407.951542:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1787380407.951544:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867507328:0@lo:400:kworker.0 00000100:00080000:0.0:1787380407.951546:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9d6ffc5bf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787380407.951550:0:3639:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 192 00000100:00100000:2.0:1787380407.951555:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867507840:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1787380407.951561:0:3639:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9d6ffc5bf000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1787380407.951581:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec44aa680 x1874203867507968/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787380407.951611:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867506816:0@lo:400:kworker.0 00000100:00100000:0.0:1787380407.951635:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867506688:0@lo:400:kworker.0 00000100:00100000:2.0:1787380407.952025:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867507968:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787380407.952057:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380407.952488:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3641:x1874203867506560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1480us (2418us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787380407.952497:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787380407.952513:0:13003:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867507968 00000100:00100000:1.0:1787380407.952517:0:13003:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867507968 00000100:00100000:1.0:1787380407.952538:0:13003:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787380407.952543:0:13003:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1874203867507968:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1787380407.952556:0:13003:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1787380407.967678:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2625000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787380407.967687:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 232 00000100:00080000:3.0:1787380407.967697:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d6ec2625000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1787380407.967733:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff3fc1880 x1874203867508096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787380407.967772:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867507456:0@lo:400:kworker.0 00000100:00100000:0.0:1787380407.967882:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1874203867508096:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787380407.967958:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380407.968012:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867508096 00000100:00100000:0.0:1787380407.968019:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867508096 00000100:00100000:0.0:1787380407.968066:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00080000:3.0:1787380407.968068:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787380407.968074:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2381800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:0.0:1787380407.968079:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1874203867508096:12345-0@lo:38:ptlrpcd_00_02.0 00000100:02000400:3.0:1787380407.968081:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787380407.968088:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2381800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787380407.968092:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 211 00000100:00080000:3.0:1787380407.968097:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d6ec2381800 using connection 192.168.206.130@tcp/0@lo 00010000:02000000:0.0:1787380407.968101:0:6521:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787380407.968141:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1874203867508096:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 64us (182us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787380407.968149:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:0.0:1787380407.968185:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2625000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787380407.968190:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787380407.968193:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1874203867508096:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787380407.968631:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3cb0e00 x1874203867508224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787380407.968660:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867507072:0@lo:400:kworker.0 00000100:00080000:2.0:1787380407.968704:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787380407.968708:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9d6ffc5b9000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787380407.968711:0:3641:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787380407.968715:0:3641:0:(import.c:65:import_set_state_nolock()) ffff9d6ffc5b9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787380407.968731:0:3641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 192 00000100:00080000:2.0:1787380407.968736:0:3641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9d6ffc5b9000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:2.0:1787380407.968751:0:3641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3cb3b80 x1874203867508352/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787380407.968763:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867506944:0@lo:400:kworker.0 00000100:02020000:2.0:1787380407.968780:0:3641:0:(client.c:1492:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:0.0:1787380407.968832:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1874203867508224:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787380407.968865:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380407.968887:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874203867508352:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787380407.968920:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380407.968949:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867508224 00000100:00100000:0.0:1787380407.968953:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867508224 00000100:00100000:0.0:1787380407.968980:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867508352 00000100:00100000:0.0:1787380407.968983:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867508352 00000100:00100000:0.0:1787380407.968998:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787380407.969003:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1874203867508224:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1787380407.969014:0:6523:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787380407.969059:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1874203867508224:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 55us (193us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787380407.969066:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787380407.969084:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787380407.969088:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1874203867508352:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1787380407.969095:0:6523:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787380407.969121:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1874203867508352:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 31us (200us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787380407.969127:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1787380407.969159:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2381800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787380407.969164:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787380407.969167:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1874203867508224:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1787380407.969175:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ffc5b9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787380407.969178:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787380407.969180:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874203867508352:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1787380407.974328:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ffc5bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787380407.974337:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787380407.974342:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867507968:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787380407.974564:0:13003:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1874203867507968:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 21655us (22141us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787380407.974574:0:13003:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:2.0:1787380407.982675:0:3641:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787380407.982682:0:3641:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff9d6ffc5bf000 already not connected (conn 2, was 1): DISCONN 00010000:00010000:1.0:1787380408.396381:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380408.464415:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380408.464438:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867508480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787380408.464499:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380408.465023:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867508480 00000100:00100000:1.0:1787380408.465157:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867508480 00000100:00100000:1.0:1787380408.465199:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787380408.465207:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867508480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787380408.465235:0:8438:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1787380408.465307:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867508480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380408.465315:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787380408.466911:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867508480:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1787380408.467947:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787380408.467958:0:9514:0:(genops.c:906:class_export_put()) final put ffff9d6ec36c1800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787380408.467987:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000020:00000080:3.0:1787380408.467989:0:9514:0:(genops.c:906:class_export_put()) final put ffff9d6fd2f4f800/7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000001:00100000:1.0:1787380408.468106:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787380408.468115:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1787380408.468118:0:7453:0:(genops.c:906:class_export_put()) final put ffff9d6ff5e60800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787380408.468124:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bd549a2a-de1a-4b9c-be02-339b2f6be909 00000001:00080000:1.0:1787380408.468129:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1787380408.468130:0:7453:0:(genops.c:906:class_export_put()) final put ffff9d6ec2625800/bd549a2a-de1a-4b9c-be02-339b2f6be909 00000001:00100000:1.0:1787380408.468134:0:7453:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000001:00080000:1.0:1787380408.468138:0:7453:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1787380408.468139:0:7453:0:(genops.c:906:class_export_put()) final put ffff9d6ec2754800/7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000020:00000080:2.0:1787380408.468356:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec36c1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787380408.468396:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fd2f4f800/7da54272-8859-4cb3-ba98-d1d4e18c7c38 for lustre-OST0001 00000020:00000080:2.0:1787380408.468417:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff5e60800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1787380408.468444:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec2625800/bd549a2a-de1a-4b9c-be02-339b2f6be909 for lustre-MDT0001 00000020:00000080:2.0:1787380408.468462:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec2754800/7da54272-8859-4cb3-ba98-d1d4e18c7c38 for lustre-MDT0001 00000020:00000080:2.0:1787380408.468481:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec36c5000 for lustre-OST0001 00000020:00000080:2.0:1787380408.468485:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6fd2f4d800 for lustre-OST0001 00000020:00000080:2.0:1787380408.468488:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ff5e62800 for lustre-MDT0001 00000020:00000080:2.0:1787380408.468491:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec2622800 for lustre-MDT0001 00000020:00000080:2.0:1787380408.468494:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ff5ca9800 for lustre-MDT0001 00000001:00100000:0.0:1787380408.469224:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787380408.469230:0:8429:0:(genops.c:906:class_export_put()) final put ffff9d6fff5a5000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787380408.469285:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000020:00000080:0.0:1787380408.469288:0:8429:0:(genops.c:906:class_export_put()) final put ffff9d6fff73a800/7da54272-8859-4cb3-ba98-d1d4e18c7c38 00000020:00000080:1.0:1787380408.469311:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fff5a5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787380408.469348:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6fff5a1800 for lustre-OST0000 00000020:00000080:2.0:1787380408.471402:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fff73a800/7da54272-8859-4cb3-ba98-d1d4e18c7c38 for lustre-OST0000 00000020:00000080:2.0:1787380408.471543:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6fff739000 for lustre-OST0000 00010000:00010000:2.0:1787380409.420527:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380410.445519:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380411.468131:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787380411.724385:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787380412.496191:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787380412.559242:0:6500:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787380412.559250:0:6500:0:(genops.c:906:class_export_put()) final put ffff9d6ff4e7e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787380412.559394:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff4e7e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1787380412.559448:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ffc7f4800 for lustre-MDT0000 00000020:01000000:2.0:1787380412.939955:0:15210:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d6ec346b4e0 - data ffff9d6ec1cb3288/ffff9d6ff5ef9400 00000020:01000000:2.0:1787380412.940094:0:15210:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d6ff3f81a80 - data ffff9d6fdf9561b0/ffff9d6ff4e82c00 00000001:00000004:2.0:1787380412.951287:0:15210:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1787380413.014116:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787380413.014125:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1787380413.014226:0:15210:0:(client.c:3150:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9d6ff3fc3100 x1874203867506176/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787380416 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380413.014252:0:15210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787380413.027377:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787380413.027385:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 4 00000004:00080000:3.0:1787380413.028949:0:15210:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787380413.028953:0:15210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787380413.036048:0:8867:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787380413.036056:0:8867:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1787380413.036070:0:8867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787380413.037099:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787380413.037105:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1787380413.037262:0:15210:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787380413.037265:0:15210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787380413.046385:0:9842:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787380413.046402:0:9842:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1787380413.046429:0:9842:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787380413.062321:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68850 00000020:00000080:0.0:1787380413.062332:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6fc479f800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787380413.062620:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc479f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787380413.068116:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68865 00000020:00000080:0.0:1787380413.068129:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6fc479a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787380413.068138:0:15210:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787380413.068144:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787380413.068151:0:15210:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787380413.068155:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9d6feb454d40) has no exports 00000100:00080000:3.0:1787380413.068273:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787380413.068279:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787380413.068282:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d6ffc5bf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787380413.068290:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 418 00000100:00080000:3.0:1787380413.068295:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787380413.068301:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9d6ffc5bf000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1787380413.068321:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff3fc2d80 x1874203867508736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787380413.068336:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787380413.068348:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787380413.068350:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d6ffc5b9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787380413.068354:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 418 00000100:00080000:3.0:1787380413.068357:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787380413.068365:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9d6ffc5b9000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1787380413.068398:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff3fc0a80 x1874203867508864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787380413.068407:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787380413.068410:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787380413.068411:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2381800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787380413.068414:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 418 00000100:00080000:3.0:1787380413.068416:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787380413.068419:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d6ec2381800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1787380413.068426:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff3fc2a00 x1874203867508992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787380413.068450:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787380413.068452:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787380413.068454:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2625000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787380413.068456:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 418 00000100:00080000:3.0:1787380413.068458:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787380413.068461:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d6ec2625000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1787380413.068470:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff3fc3b80 x1874203867509376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:3.0:1787380413.068497:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc479a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000100:00100000:3.0:1787380413.068521:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867508608:0@lo:400:kworker.0 00000100:00100000:3.0:1787380413.068578:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380413.068631:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867509632:0@lo:400:kworker.0 00000100:00100000:3.0:1787380413.068664:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380413.068685:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380413.068754:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867509504:0@lo:400:kworker.0 00000100:00100000:3.0:1787380413.068776:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380413.068837:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867508736:0@lo:38:kworker.0 00000100:00100000:3.0:1787380413.068858:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380413.068872:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874203867508864:0@lo:38:kworker.0 00000100:00100000:3.0:1787380413.068886:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380413.068896:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1874203867508992:0@lo:38:kworker.0 00000100:00100000:3.0:1787380413.068909:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380413.068919:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1874203867509376:0@lo:38:kworker.0 00000100:00100000:3.0:1787380413.068932:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380413.068963:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867509120:0@lo:400:kworker.0 00000100:00100000:3.0:1787380413.068980:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380413.068991:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867509760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787380413.069007:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380413.069019:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380413.069023:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867509248:0@lo:400:kworker.0 00000100:00100000:3.0:1787380413.069036:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380413.069061:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867508608 00000100:00100000:3.0:1787380413.069067:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867508608 00000100:00100000:3.0:1787380413.069114:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1787380413.069131:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:3642:x1874203867508608:12345-0@lo:400:kworker.0 00000004:01000000:0.0:1787380413.069154:0:15210:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787380413.069164:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68c9b 00000020:00000080:0.0:1787380413.069171:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6ec36c7000/lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787380413.069176:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1e31f5e-7395-4c34-a795-7159073dc2a2+19:3642:x1874203867508608:12345-0@lo:400:kworker.0 Request processed in 47us (597us total) trans 0 rc 0/0 00000020:01000000:0.0:1787380413.069181:0:15210:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000100:00100000:3.0:1787380413.069186:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000020:00000080:0.0:1787380413.069189:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787380413.069204:0:15210:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787380413.069208:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 28 (ffff9d6ff4c60000) has no exports 00000020:00000080:0.0:1787380413.069215:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68c94 00000020:00000080:0.0:1787380413.069220:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6ec376d000/lustre-MDT0000-osd_UUID 00000100:00100000:3.0:1787380413.069222:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867509632 00000100:00100000:3.0:1787380413.069227:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867509632 00000100:00100000:3.0:1787380413.069260:0:8871:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867509248 00000100:00100000:3.0:1787380413.069263:0:8871:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867509248 00000100:00100000:3.0:1787380413.069287:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787380413.069295:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867509632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380413.069397:0:14727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867509504 00000100:00100000:1.0:1787380413.069400:0:14727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867509504 00000100:00100000:1.0:1787380413.069424:0:14727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867508864 00000100:00100000:1.0:1787380413.069426:0:14727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867508864 00000100:00100000:1.0:1787380413.069435:0:14727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867508992 00000100:00100000:1.0:1787380413.069437:0:14727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867508992 00000100:00100000:1.0:1787380413.069445:0:14727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867509376 00000100:00100000:1.0:1787380413.069447:0:14727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867509376 00000100:00100000:1.0:1787380413.069464:0:14727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867509120 00000100:00100000:1.0:1787380413.069467:0:14727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867509120 00000100:00100000:1.0:1787380413.069490:0:14727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787380413.069498:0:14727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867509504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380413.069530:0:14727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867509504:12345-0@lo:400:kworker.0 Request processed in 33us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380413.069535:0:14727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1787380413.069545:0:14727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1787380413.069550:0:14727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867509120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380413.069575:0:14727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867509120:12345-0@lo:400:kworker.0 Request processed in 25us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380413.069580:0:14727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1787380413.069589:0:14727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1787380413.069592:0:14727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1874203867508864:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1787380413.069602:0:14727:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787380413.069666:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867509632:12345-0@lo:400:kworker.0 Request processed in 59us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380413.069675:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787380413.069689:0:8871:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787380413.069695:0:8871:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867509248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380413.069721:0:8871:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867509248:12345-0@lo:400:kworker.0 Request processed in 27us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380413.069725:0:8871:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787380413.069754:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867508736 00000100:00100000:3.0:1787380413.069758:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867508736 00000100:00100000:3.0:1787380413.069779:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787380413.069784:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1874203867508736:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787380413.069792:0:6527:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787380413.069843:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1874203867508736:12345-0@lo:38:kworker.0 Request processed in 58us (984us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787380413.069849:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787380413.069867:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787380413.069881:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1874203867508992:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787380413.069888:0:6523:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787380413.069910:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1874203867508992:12345-0@lo:38:kworker.0 Request processed in 30us (1000us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787380413.069916:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787380413.069929:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1787380413.069933:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1874203867509376:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1787380413.069939:0:6523:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:01000000:0.0:1787380413.069949:0:15210:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787380413.069954:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787380413.069959:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1874203867509376:12345-0@lo:38:kworker.0 Request processed in 23us (1024us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787380413.069959:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1787380413.069967:0:15210:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787380413.069968:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787380413.069970:0:15210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1787380413.069994:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867509760 00000100:00100000:3.0:1787380413.069998:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867509760 00000020:00000080:0.0:1787380413.070001:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000100:00100000:3.0:1787380413.070019:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787380413.070024:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867509760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787380413.070039:0:13810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1787380413.070065:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867509760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380413.070071:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:3.0:1787380413.070092:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787380413.070096:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787380413.070098:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1787380413.070112:0:15210:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787380413.070119:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68b59 00000020:00000080:0.0:1787380413.070130:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6fff5a6800/lustre-MDT0000-mdtlov_UUID 00000100:00080000:3.0:1787380413.070132:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ffc5bf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000020:01000000:0.0:1787380413.070135:0:15210:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000100:00080000:3.0:1787380413.070138:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000020:00000080:0.0:1787380413.070140:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000100:00100000:3.0:1787380413.070144:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867508736:0@lo:38:kworker.0 00000020:00000080:0.0:1787380413.070148:0:15210:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787380413.070152:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 22 (ffff9d6ff5f60000) has no exports 00000100:00080000:3.0:1787380413.070154:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2381800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000020:00000080:0.0:1787380413.070157:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68b52 00000100:00080000:3.0:1787380413.070159:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000020:00000080:0.0:1787380413.070162:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6ec20b9800/lustre-MDT0000-osd_UUID 00000100:00100000:3.0:1787380413.070170:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1874203867508992:0@lo:38:kworker.0 00000100:00080000:3.0:1787380413.070184:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2625000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787380413.070187:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787380413.070190:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1874203867509376:0@lo:38:kworker.0 00010000:00080000:3.0:1787380413.070235:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff3fc2300 x1874203867509504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380413.070245:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867509504:0@lo:400:kworker.0 00000100:00100000:3.0:1787380413.070257:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:3642:1874203867508608:0@lo:400:kworker.0 00000100:00100000:3.0:1787380413.070272:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867509632:0@lo:400:kworker.0 00010000:01000000:0.0:1787380413.072559:0:15210:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787380413.072565:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787380413.072569:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 5 00000004:00080000:0.0:1787380413.072574:0:15210:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787380413.072576:0:15210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787380413.072608:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787380413.072619:0:15210:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1787380413.072631:0:15210:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787380413.072648:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68a09 00000020:00000080:0.0:1787380413.072655:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6ff5ca9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787380413.072660:0:15210:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1787380413.072664:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787380413.072668:0:15210:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787380413.072671:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9d6ffb9099c0) has no exports 00000020:00000080:0.0:1787380413.072677:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68a02 00000020:00000080:0.0:1787380413.072680:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6fcfe12800/lustre-MDT0000-osd_UUID 00000100:00100000:1.0:1787380413.076470:0:14727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3638:x1874203867508864:12345-0@lo:38:kworker.0 Request processed in 6859us (7566us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787380413.076484:0:14727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:1.0:1787380413.076536:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ffc5b9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787380413.076540:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787380413.076544:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874203867508864:0@lo:38:kworker.0 00000020:00000080:1.0:1787380413.076578:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec36c7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787380413.076629:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec376d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787380413.076635:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec3769800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787380413.076652:0:37:0:(genops.c:906:class_export_put()) final put ffff9d6ec36c0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787380413.076655:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec36c0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787380413.076667:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787380413.076778:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fff5a6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787380413.076783:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec20b9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787380413.076787:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec20bd000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787380413.076791:0:37:0:(genops.c:906:class_export_put()) final put ffff9d6ec20b8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787380413.076793:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec20b8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787380413.076795:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787380413.077691:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff5ca9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787380413.077697:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fcfe12800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1787380413.077732:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867509248:0@lo:400:kworker.0 00010000:00080000:1.0:1787380413.077746:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff3fc1c00 x1874203867509120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380413.077755:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867509120:0@lo:400:kworker.0 00000100:00100000:1.0:1787380413.077770:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867509760:0@lo:13:osp-pre-1-1.0 00010000:01000000:1.0:1787380413.077826:0:15210:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1787380413.077831:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787380413.077834:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1787380413.077839:0:15210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787380413.077855:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6fcfe16000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1787380413.077886:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787380413.077896:0:15210:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787380413.077899:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6ff4ffb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787380413.077901:0:15210:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff4ffb000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1787380413.077905:0:15210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787380413.077955:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787380413.077966:0:15210:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787380413.077969:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6fcff5f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787380413.077970:0:15210:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fcff5f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787380413.077974:0:15210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787380413.078016:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad6886c 00000020:00000080:1.0:1787380413.078021:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6fc479a800/lustre-MDD0000_UUID 00000020:01000000:1.0:1787380413.078027:0:15210:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787380413.078032:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc479a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787380413.078039:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787380413.078043:0:15210:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787380413.078046:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9d6feb453380) has no exports 00000020:00000080:1.0:1787380413.078064:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787380413.078067:0:15210:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787380413.078069:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6fc479e800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787380413.078071:0:15210:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc479e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787380413.078074:0:15210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787380413.078098:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68873 00000020:00000080:1.0:1787380413.078102:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6fc4799000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787380413.078113:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc4799000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1787380413.078123:0:15210:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6fc873b000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787380413.078130:0:15210:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6fc873b000 3 00000020:01000004:1.0:1787380413.078133:0:15210:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d6fc873b000 from lustre-MDT0000 00000020:00000080:1.0:1787380413.078160:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787380413.078164:0:15210:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787380413.078166:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6fc479b800/lustre-MDT0000_UUID 00000020:00000080:1.0:1787380413.078168:0:15210:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc479b800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787380413.078174:0:15210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787380413.078198:0:15210:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1787380413.078201:0:15210:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787380413.078203:0:15210:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787380413.078208:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787380413.078211:0:15210:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787380413.078218:0:15210:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9d6feb4fa800 c1e31f5e-7395-4c34-a795-7159073dc2a2 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787380413.078223:0:15210:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9d6feb450000) has exports, disconnecting them 00000020:00080000:1.0:1787380413.078227:0:15210:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9d6feb4fa800), last request at 1787380163 00000020:00000080:1.0:1787380413.078237:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68811 00000020:00010000:1.0:1787380413.078240:0:15210:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9d6feb4fa800: total 0 00000100:00080000:1.0:1787380413.078243:0:15210:0:(import.c:65:import_set_state_nolock()) ffff9d6feb4fa000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787380413.078251:0:15210:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d6feb4fa800): rc 0 00000020:00080000:1.0:1787380413.078254:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9d6feb450000) has no exports 00000020:00010000:1.0:1787380413.078260:0:6510:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9d6feb4fa800: total 0 00010000:00010000:1.0:1787380413.078278:0:6510:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9d6feb4fa800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787380413.078301:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9a600/0xcf3c46fdcad68d58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad68d51 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380413.078315:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fc165b600/0xcf3c46fdcad6890d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad68906 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380413.078326:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9b400/0xcf3c46fdcad68d66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad68d5f expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380413.078336:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d7002044600/0xcf3c46fdcad6891b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad68914 expref: 11 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380413.078346:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7866000/0xcf3c46fdcad68fb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad68fab expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380413.078355:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9a800/0xcf3c46fdcad68fc0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad68fb9 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380413.078363:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5d47a00/0xcf3c46fdcad68fce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad68fc7 expref: 8 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380413.078382:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7867e00/0xcf3c46fdcad68d90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad68d89 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380413.078391:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9b800/0xcf3c46fdcad68d20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad68d19 expref: 6 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380413.078400:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffb89c000/0xcf3c46fdcad68c32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad68c2b expref: 5 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380413.078409:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9ae00/0xcf3c46fdcad68d2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad68d27 expref: 4 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380413.078417:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5fda400/0xcf3c46fdcad68d3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad68d35 expref: 3 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380413.078424:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe0a9a400/0xcf3c46fdcad68d4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcf3c46fdcad68d43 expref: 2 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380413.078432:0:6510:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9d6feb4fa800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1787380413.078441:0:6510:0:(genops.c:906:class_export_put()) final put ffff9d6feb4fa800/c1e31f5e-7395-4c34-a795-7159073dc2a2 00010000:00010000:1.0:1787380413.078448:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380413.078449:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380413.078451:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787380413.078455:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6feb4fa800/c1e31f5e-7395-4c34-a795-7159073dc2a2 for MGS 00000020:00000080:1.0:1787380413.078570:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6feb4fa000 for MGS 00000100:00100000:1.0:1787380413.078623:0:6513:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9d6feb660200:6513] 0 exiting: rc = 1 00000100:00100000:3.0:1787380413.083099:0:6515:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9d6fd0435600:6515] 1 exiting: rc = 0 00000100:00100000:3.0:1787380413.083184:0:6516:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9d6fd0434200:6516] 2 exiting: rc = 0 00000100:00100000:1.0:1787380413.083286:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083294:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083299:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083313:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083317:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083323:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083328:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083334:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083339:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083345:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083350:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083355:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083360:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083365:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083371:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083377:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083384:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083389:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083394:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083400:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083405:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083411:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083418:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083427:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083433:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083439:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083444:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083449:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083454:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083470:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083475:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083481:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083486:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083491:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083496:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083500:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083505:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083510:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083521:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083526:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083530:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083535:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083540:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083545:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083550:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083555:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083559:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083564:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083569:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083574:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083579:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083585:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083590:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083595:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083599:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083604:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083608:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083613:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083617:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083622:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083627:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083631:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083647:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380413.083652:0:15210:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1787380413.088011:0:15210:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d6ec36131e0 - data ffff9d6fdfb3c1b0/ffff9d6ec369f000 00000020:01000000:3.0:1787380413.088131:0:15210:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d6ff3d66240 - data ffff9d6fdf806a20/ffff9d6feb650400 00000020:00000080:3.0:1787380413.088578:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad687f5 00000020:00000080:3.0:1787380413.088585:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6fc8202800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787380413.088600:0:15210:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6fc873b000 from MGS, refs=2 00000020:01000004:3.0:1787380413.088603:0:15210:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6fc873b000 2 00000020:01000004:3.0:1787380413.088606:0:15210:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d6fc873b000 from MGS 00000020:00000080:3.0:1787380413.088626:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787380413.088631:0:15210:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1787380413.088633:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6fc8205000/MGS 00000020:00000080:3.0:1787380413.088646:0:15210:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc8205000/MGS for MGS 00000020:01000000:3.0:1787380413.088651:0:15210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1787380413.088704:0:15210:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1787380413.088707:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787380413.088711:0:15210:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00000080:1.0:1787380413.088740:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc8202800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:3.0:1787380413.088766:0:15210:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9d6fc473d800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787380413.088781:0:15210:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9d6ff88299c0) has exports, disconnecting them 00000020:00080000:3.0:1787380413.088785:0:15210:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9d6fc473d800), last request at 1787380164 00000020:00000080:3.0:1787380413.088789:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad688c0 00000020:00080000:3.0:1787380413.088796:0:15210:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d6fc473d800): rc 0 00000020:00000080:3.0:1787380413.088800:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6fc473d800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787380413.089165:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc473d800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1787380413.107178:0:15210:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1787380413.107187:0:15210:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787380413.107191:0:15210:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787380413.107197:0:15210:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787380413.107312:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6fc473c800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787380413.112583:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787380413.112595:0:15210:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1787380413.112600:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6fc473a000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787380413.112604:0:15210:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc473a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787380413.112611:0:15210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1787380413.112701:0:15210:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6fc873b000 1 00000020:00000080:3.0:1787380413.112706:0:15210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad687e7 00000020:00000080:3.0:1787380413.112712:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6fc8200800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787380413.112721:0:15210:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1787380413.112724:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787380413.112728:0:15210:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787380413.112731:0:15210:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9d6ff882b380) has no exports 00000020:00000080:1.0:1787380413.113196:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc8200800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787380413.151870:0:15210:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787380413.153658:0:15210:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787380413.153669:0:15210:0:(genops.c:906:class_export_put()) final put ffff9d6fc873c800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787380413.153674:0:15210:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc873c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787380413.153689:0:15210:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787380413.154166:0:15210:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d6fc873f000 00000020:02000400:2.0:1787380413.154275:0:15210:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1787380413.518113:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380413.580753:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380413.584353:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867509888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787380413.584441:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380413.584555:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867509888 00000100:00100000:3.0:1787380413.584563:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867509888 00000100:00100000:3.0:1787380413.584614:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787380413.584623:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867509888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787380413.584660:0:8437:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1787380413.584712:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867509888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380413.584720:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787380413.584863:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867509888:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1787380414.541183:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380415.568399:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380416.587909:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787380416.751218:0:15411:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787380416.772023:0:15411:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1787380416.772070:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46a00/0xcf3c46fdcad68d51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d58 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.772085:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46a00/0xcf3c46fdcad68d51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68d58 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.772093:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46a00/0xcf3c46fdcad68d51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68d58 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.772099:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46a00/0xcf3c46fdcad68d51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68d58 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.772276:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787380416.772282:0:15411:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787380416.772307:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787380416.772311:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787380416.772316:0:15411:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787380416.772322:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9d6ffc5b9000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787380416.772326:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787380416.772328:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787380416.772330:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787380416.772711:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380416.772789:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46a00/0xcf3c46fdcad68d51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68d58 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380416.772798:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46a00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:0.0:1787380416.772802:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46a00/0xcf3c46fdcad68d51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68d58 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380416.772843:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46a00/0xcf3c46fdcad68d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3c46fdcad68d58 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380416.772851:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46a00/0xcf3c46fdcad68d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3c46fdcad68d58 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380416.772857:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787380416.772860:0:8451:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787380416.772862:0:8451:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787380416.772895:0:8451:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46a00/0xcf3c46fdcad68d51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68d58 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380416.772912:0:8451:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380416.773680:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46a00/0xcf3c46fdcad68d51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68d58 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380416.773692:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46a00/0xcf3c46fdcad68d51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68d58 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380416.773706:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380416.773708:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380416.773710:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380416.773765:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867510016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787380416.773848:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380416.773912:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867510016 00000100:00100000:2.0:1787380416.773919:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867510016 00000100:00100000:2.0:1787380416.773962:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787380416.773969:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3a0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3641:x1874203867510016:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787380416.773975:0:6506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787380416 with bad export cookie 14932888520297449489 00010000:00010000:3.0:1787380416.778905:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47400/0xcf3c46fdcad68d5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d66 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.778924:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47400/0xcf3c46fdcad68d5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68d66 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.779604:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47400/0xcf3c46fdcad68d5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68d66 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.779636:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47400/0xcf3c46fdcad68d5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68d66 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.779662:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380416.779670:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbc00/0xcf3c46fdcad68c2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68c32 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.779678:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbc00/0xcf3c46fdcad68c2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68c32 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.779685:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbc00/0xcf3c46fdcad68c2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68c32 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.779691:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbc00/0xcf3c46fdcad68c2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68c32 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.780065:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787380416.780081:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787380416.780086:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47400/0xcf3c46fdcad68d5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68d66 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.780094:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47400 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380416.780098:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47400/0xcf3c46fdcad68d5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68d66 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.780107:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47400/0xcf3c46fdcad68d5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3c46fdcad68d66 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380416.780114:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47400/0xcf3c46fdcad68d5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3c46fdcad68d66 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380416.780127:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787380416.780130:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1787380416.780162:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47400/0xcf3c46fdcad68d5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68d66 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.780170:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787380416.782067:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380416.782078:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbc00/0xcf3c46fdcad68c2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68c32 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380416.782089:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdbc00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:2.0:1787380416.782092:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbc00/0xcf3c46fdcad68c2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68c32 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380416.782101:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbc00/0xcf3c46fdcad68c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3c46fdcad68c32 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380416.782107:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbc00/0xcf3c46fdcad68c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3c46fdcad68c32 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380416.782113:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787380416.782115:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787380416.782130:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787380416.782158:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbc00/0xcf3c46fdcad68c2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68c32 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380416.782164:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787380416.782187:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbc00/0xcf3c46fdcad68c2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68c32 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380416.782194:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fdbc00/0xcf3c46fdcad68c2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68c32 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380416.782210:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380416.782212:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380416.782214:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380416.782229:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867510272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787380416.782285:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380416.782343:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867510272 00000100:00100000:2.0:1787380416.782350:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867510272 00000100:00100000:2.0:1787380416.782448:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787380416.782456:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1874203867510272:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787380416.782461:0:6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787380416 with bad export cookie 14932888520297449489 00000100:00100000:2.0:1787380416.782500:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3639:x1874203867510272:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (215us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787380416.782506:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787380416.782539:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.130@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787380416.782544:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9d6ff3dab800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787380416.782548:0:3639:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1787380416.784040:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47400/0xcf3c46fdcad68d5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68d66 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.784056:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47400/0xcf3c46fdcad68d5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68d66 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.784073:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380416.784075:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380416.784077:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380416.784097:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68fc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68fce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.784106:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68fc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68fce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.784113:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68fc7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68fce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.784120:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68fc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68fce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.784139:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380416.784146:0:15411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030000/0xcf3c46fdcad68914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6891b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.784166:0:15411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030000/0xcf3c46fdcad68914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad6891b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.784172:0:15411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030000/0xcf3c46fdcad68914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad6891b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.784190:0:15411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030000/0xcf3c46fdcad68914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad6891b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.784203:0:15411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787380416.784207:0:15411:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1787380416.784214:0:15411:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1787380416.784245:0:15411:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1787380416.784249:0:15411:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1787380416.784254:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787380416.784260:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1787380416.784266:0:15411:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9d6ec2756000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787380416.784271:0:15411:0:(genops.c:1840:print_export_data()) lustre-MDT0001: ACTIVE ffff9d6fcff59000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787380416.784276:0:15411:0:(genops.c:1574:class_disconnect_exports()) OBD device 11 (ffff9d6ff4f719c0) has exports, disconnecting them 00000020:00080000:3.0:1787380416.784280:0:15411:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9d6ec2756000), last request at 1787380413 00000020:00000080:3.0:1787380416.784287:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68bf3 00000100:00080000:3.0:1787380416.784303:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2756800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787380416.784338:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787380416.784344:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68fc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68fce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.784351:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47c00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380416.784355:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68fc7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68fce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.784369:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68fc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3c46fdcad68fce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380416.784376:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68fc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3c46fdcad68fce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380416.784381:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787380416.784383:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787380416.784385:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:2.0:1787380416.789763:0:3639:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.130@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787380416.789770:0:3639:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787380416.789799:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6fc43eb480 x1874203867510016/t0(0) o103->MGC192.168.206.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787380432 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380416.789831:0:3639:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ec3cb3100 x1874203867510272/t0(0) o103->MGC192.168.206.130@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787380432 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787380416.789841:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787380416.789844:0:3639:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787380416.789846:0:3639:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:3.0:1787380416.790318:0:6509:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68fc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68fce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.790330:0:6509:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380416.790352:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68fc7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68fce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.790361:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47c00/0xcf3c46fdcad68fc7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcf3c46fdcad68fce expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.790391:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380416.790395:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030000/0xcf3c46fdcad68914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad6891b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.790402:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc0030000 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380416.790406:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030000/0xcf3c46fdcad68914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad6891b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.790414:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030000/0xcf3c46fdcad68914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3c46fdcad6891b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380416.790433:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030000/0xcf3c46fdcad68914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3c46fdcad6891b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380416.790438:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787380416.790441:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787380416.790444:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787380416.790458:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d6ff3dab800 00010000:00010000:3.0:1787380416.790461:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030000/0xcf3c46fdcad68914 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3c46fdcad6891b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.790468:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fc0030000/0xcf3c46fdcad68914 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3c46fdcad6891b expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380416.790483:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380416.790485:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380416.790487:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380416.790508:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1e31f5e-7395-4c34-a795-7159073dc2a2:0:1874203867510400:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787380416.790560:0:15411:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d6ec2756000): rc 0 00000020:00000080:3.0:1787380416.790564:0:15411:0:(genops.c:906:class_export_put()) final put ffff9d6ec2756000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1787380416.790584:0:15411:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9d6fcff59000), last request at 1787380413 00000020:00000080:3.0:1787380416.790591:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68acd 00000100:00080000:3.0:1787380416.790600:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9d6fcff58800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787380416.790627:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787380416.790636:0:15411:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d6fcff59000): rc 0 00000020:00000080:3.0:1787380416.790638:0:15411:0:(genops.c:906:class_export_put()) final put ffff9d6fcff59000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1787380416.790646:0:15411:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb3a801e07ae0 00000100:00080000:3.0:1787380416.790665:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787380416.790673:0:15411:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9d6ec3f8d180 x1874203867506560/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787380423 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380416.790689:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000020:00000080:1.0:1787380416.792207:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec2756000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1787380416.792260:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fcff59000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1787380416.792284:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec2756800 for lustre-MDT0001 00000020:00000080:1.0:1787380416.792288:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6fcff58800 for lustre-MDT0001 00000100:00080000:3.0:1787380416.792987:0:15411:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787380416.792995:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9d6ffc5bf000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:0.0:1787380416.793444:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1e31f5e-7395-4c34-a795-7159073dc2a2:0:1874203867510144:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787380416.793480:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787380416.793667:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787380416.793671:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1787380416.793692:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787380416.793760:0:15411:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787380416.793780:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9d6ec20bc800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787380416.793792:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787380416.793795:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1787380416.793801:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787380416.793876:0:15411:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787380416.793884:0:15411:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3396000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787380416.794016:0:3639:0:(import.c:65:import_set_state_nolock()) ffff9d6ff3dab800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787380416.794023:0:3639:0:(import.c:510:import_select_connection()) MGC192.168.206.130@tcp: connect to NID 0@lo last attempt 173 00000100:00080000:2.0:1787380416.794030:0:3639:0:(import.c:624:import_select_connection()) MGC192.168.206.130@tcp: import ffff9d6ff3dab800 using connection 192.168.206.130@tcp/0@lo 00000020:00080000:3.0:1787380416.794048:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9d6ff4f719c0) has no exports 00000100:00100000:1.0:1787380416.794116:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867510528:0@lo:9:umount.0 00000100:00100000:1.0:1787380416.794175:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380416.794262:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1e31f5e-7395-4c34-a795-7159073dc2a2:3641:1874203867510016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787380416.794269:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867506560:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787380416.794291:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380416.794328:0:3639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3cb0380 x1874203867510784/t0(0) o250->MGC192.168.206.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787380416.794346:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1e31f5e-7395-4c34-a795-7159073dc2a2:3639:1874203867510272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380416.794457:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867510656:0@lo:9:umount.0 00000100:00100000:1.0:1787380416.794481:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380416.794502:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1e31f5e-7395-4c34-a795-7159073dc2a2:3638:1874203867510784:0@lo:250:ptlrpcd_00_00.0 00000100:00100000:3.0:1787380416.794606:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867510528 00000100:00100000:3.0:1787380416.794613:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867510528 00000100:00100000:3.0:1787380416.794664:0:12152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867510656 00000100:00100000:3.0:1787380416.794667:0:12152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867510656 00000100:00100000:3.0:1787380416.794684:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787380416.794690:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1874203867510528:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787380416.794710:0:12152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68b1a 00000100:00080000:3.0:1787380416.794726:0:12152:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2382000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787380416.794756:0:12152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:3.0:1787380416.794888:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3638:x1874203867510528:12345-0@lo:9:umount.0 Request processed in 197us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380416.794894:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787380416.795093:0:12152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787380416.795108:0:12152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1874203867510656:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787380416.795119:0:12152:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68c5c 00000100:00080000:3.0:1787380416.795123:0:12152:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2752800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787380416.795145:0:12152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1787380416.795225:0:12152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+2:3638:x1874203867510656:12345-0@lo:9:umount.0 Request processed in 117us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380416.795231:0:12152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1787380416.795248:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787380416.795251:0:6517:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787380416.795262:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1787380416.795388:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874203867510784 offset 0 length 520: 4 00000100:00080000:1.0:1787380416.795424:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec20bc800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787380416.795445:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787380416.795447:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787380416.795450:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867510528:0@lo:9:umount.0 00000100:00080000:1.0:1787380416.795461:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3396000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1787380416.795464:0:3638:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1787380416.795466:0:3638:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787380416.795468:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867510656:0@lo:9:umount.0 00000400:00000100:2.0:1787380416.795712:0:6506:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1874203867510016 offset 224 length 224: 4 00000100:00100000:2.0:1787380416.795725:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3a0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3641:x1874203867510016:12345-0@lo:103:ldlm_bl.0 Request processed in 21755us (21878us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787380416.795733:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1787380416.797017:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787380416.807417:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9d6ff4f719c0) has no exports 00000020:01000000:2.0:1787380416.853961:0:15411:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d6ec346b180 - data ffff9d6fdfb201b0/ffff9d6ff5ef9800 00000020:01000000:2.0:1787380416.854111:0:15411:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d6ff5dc1180 - data ffff9d6fdf9ac510/ffff9d6ff5e5f800 00000001:00000004:2.0:1787380416.866143:0:15411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:1.0:1787380416.929508:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787380416.929516:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1787380416.929524:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787380416.937475:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787380416.937483:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1787380416.937493:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787380416.937505:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1787380416.938406:0:8860:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1787380416.938413:0:8860:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1787380416.938424:0:8860:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1787380416.939003:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787380416.939008:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1787380416.939022:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787380416.939024:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787380416.939198:0:9838:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787380416.939202:0:9838:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1787380416.939220:0:9838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787380416.943142:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68937 00000020:00000080:1.0:1787380416.943154:0:15411:0:(genops.c:906:class_export_put()) final put ffff9d6ff4ffc800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787380416.943327:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff4ffc800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787380416.950154:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad6894c 00000020:00000080:1.0:1787380416.950168:0:15411:0:(genops.c:906:class_export_put()) final put ffff9d6ffb912800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787380416.950190:0:15411:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1787380416.950195:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787380416.950203:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787380416.950207:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9d6ffb90cd40) has no exports 00000020:00000080:2.0:1787380416.950357:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffb912800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:1.0:1787380416.950661:0:15411:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787380416.950669:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68c55 00000020:00000080:1.0:1787380416.950673:0:15411:0:(genops.c:906:class_export_put()) final put ffff9d6ec30ff000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787380416.950684:0:15411:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787380416.950688:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787380416.950694:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787380416.950697:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 27 (ffff9d6ff4c63380) has no exports 00000020:00000080:1.0:1787380416.950702:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68c4e 00000020:00000080:1.0:1787380416.950705:0:15411:0:(genops.c:906:class_export_put()) final put ffff9d6ec3396800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787380416.951153:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec30ff000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1787380416.951161:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec3396800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787380416.951334:0:15411:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787380416.951338:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787380416.951342:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1787380416.951346:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787380416.951348:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787380416.951464:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787380416.951472:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787380416.951477:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68b13 00000020:00000080:1.0:1787380416.951490:0:15411:0:(genops.c:906:class_export_put()) final put ffff9d6ec2386800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787380416.951494:0:15411:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1787380416.951497:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787380416.951501:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787380416.951503:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 21 (ffff9d6ffc738000) has no exports 00000020:00000080:1.0:1787380416.951525:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68b0c 00000020:00000080:1.0:1787380416.951529:0:15411:0:(genops.c:906:class_export_put()) final put ffff9d6ec20be800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787380416.951885:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec3396000 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1787380416.951892:0:37:0:(genops.c:906:class_export_put()) final put ffff9d6ec3392800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787380416.951894:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec3392800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1787380416.951899:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787380416.951977:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec2386800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1787380416.951984:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec20be800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787380416.952077:0:15411:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1787380416.952080:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787380416.952082:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1787380416.952085:0:15411:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787380416.952086:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787380416.952123:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787380416.952132:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787380416.952203:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec20bc800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1787380416.952209:0:37:0:(genops.c:906:class_export_put()) final put ffff9d6ec20bf000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787380416.952211:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec20bf000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1787380416.952216:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1787380416.952451:0:15411:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787380416.952457:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad6896f 00000020:00000080:1.0:1787380416.952462:0:15411:0:(genops.c:906:class_export_put()) final put ffff9d6ffc719800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1787380416.952467:0:15411:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1787380416.952470:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787380416.952474:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787380416.952477:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9d6ff4f70000) has no exports 00000020:00000080:1.0:1787380416.952481:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68968 00000020:00000080:1.0:1787380416.952483:0:15411:0:(genops.c:906:class_export_put()) final put ffff9d6ffc5ba000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787380416.952641:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffc719800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1787380416.952649:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffc5ba000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1787380416.958402:0:15411:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1787380416.958411:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787380416.958414:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1787380416.958422:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787380416.958477:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787380416.958488:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787380416.958527:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787380416.958531:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787380416.958537:0:15411:0:(genops.c:906:class_export_put()) final put ffff9d6ff4ffa000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787380416.958541:0:15411:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff4ffa000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1787380416.958548:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787380416.958713:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68953 00000020:00000080:3.0:1787380416.959066:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ffc5bf000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787380416.959075:0:37:0:(genops.c:906:class_export_put()) final put ffff9d6ffc5be000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787380416.959077:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffc5be000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1787380416.959086:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787380416.959310:0:15411:0:(genops.c:906:class_export_put()) final put ffff9d6ffb911000/lustre-MDD0001_UUID 00000020:01000000:2.0:1787380416.959326:0:15411:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1787380416.959342:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787380416.959347:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787380416.959350:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9d6ff4f73380) has no exports 00000020:00000080:2.0:1787380416.959379:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787380416.959383:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1787380416.959387:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad6895a 00000020:00000080:2.0:1787380416.959390:0:15411:0:(genops.c:906:class_export_put()) final put ffff9d6ffb910800/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1787380416.959397:0:15411:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6ff3dad800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1787380416.959400:0:15411:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6ff3dad800 2 00000020:01000004:2.0:1787380416.959403:0:15411:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d6ff3dad800 from lustre-MDT0001 00000020:00000080:2.0:1787380416.959469:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787380416.959473:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1787380416.959475:0:15411:0:(genops.c:906:class_export_put()) final put ffff9d6fd685a000/lustre-MDT0001_UUID 00000020:00000080:2.0:1787380416.959477:0:15411:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fd685a000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1787380416.959485:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1787380416.959514:0:15411:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1787380416.959517:0:15411:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1787380416.959519:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787380416.959522:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787380416.959527:0:15411:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9d6ffc718000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787380416.959532:0:15411:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9d6ffc7399c0) has exports, disconnecting them 00000020:00080000:2.0:1787380416.959536:0:15411:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9d6ffc718000), last request at 1787380182 00000020:00000080:2.0:1787380416.959539:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad689ae 00000020:00080000:2.0:1787380416.959548:0:15411:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d6ffc718000): rc 0 00000020:00000080:2.0:1787380416.959551:0:15411:0:(genops.c:906:class_export_put()) final put ffff9d6ffc718000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787380416.959726:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffb911000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1787380416.959731:0:37:0:(genops.c:906:class_export_put()) final put ffff9d6ffb916000/lustre-MDD0001_UUID 00000020:00000080:3.0:1787380416.959733:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffb916000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1787380416.959736:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1787380416.959918:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffb910800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787380416.959923:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffc718000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1787380416.961879:0:15411:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1787380416.961887:0:15411:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787380416.961891:0:15411:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787380416.961897:0:15411:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787380416.961919:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ffc5b9000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787380416.962038:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787380416.962045:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1787380416.962059:0:15411:0:(genops.c:906:class_export_put()) final put ffff9d6ffc71a800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1787380416.962062:0:15411:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffc71a800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1787380416.962067:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1787380416.962136:0:15411:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6ff3dad800 1 00000020:00000080:3.0:1787380416.962141:0:15411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad688ea 00000020:00000080:3.0:1787380416.962147:0:15411:0:(genops.c:906:class_export_put()) final put ffff9d6fcfe16800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1787380416.962159:0:15411:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1787380416.962166:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fcfe16800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787380416.962174:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787380416.962435:0:15411:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787380416.962439:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9d6ff4f74d40) has no exports 00000020:00000080:3.0:1787380417.009330:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787380417.009343:0:15411:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1787380417.009348:0:15411:0:(genops.c:906:class_export_put()) final put ffff9d6ff4c81000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1787380417.009353:0:15411:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff4c81000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1787380417.009362:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1787380417.009473:0:15411:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d6ff3dac000 00000020:01000000:3.0:1787380417.009497:0:15411:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787380417.009501:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787380417.009505:0:15411:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787380417.009509:0:15411:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9d6ff882cd40) has no exports 00000100:00100000:3.0:1787380417.009923:0:6522:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9d6fc7e24400:6522] 1 exiting: rc = 0 00000100:00100000:3.0:1787380417.010022:0:10154:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9d6ec372e600:10154] 3 exiting: rc = 0 00000100:00100000:3.0:1787380417.010113:0:6521:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9d6fd1431800:6521] 0 exiting: rc = 1 00000100:00100000:1.0:1787380417.010269:0:6523:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9d6fd220d200:6523] 2 exiting: rc = 0 00000100:00100000:1.0:1787380417.010508:0:14727:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9d6ec3d2ec00:14727] 4 exiting: rc = 0 00000100:00100000:3.0:1787380417.010604:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010612:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010630:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010635:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010641:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010646:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010652:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010669:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010674:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010680:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010685:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010690:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010695:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010700:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010706:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010711:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010729:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010740:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010746:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010751:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010756:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010761:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010766:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010771:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010777:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010782:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010788:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010794:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010799:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010803:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010828:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010835:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010841:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010847:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010852:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010868:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010874:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010879:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010884:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010890:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010895:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010900:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010913:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010918:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010923:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010928:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010933:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010939:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010945:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010951:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010957:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010962:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010967:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010971:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010976:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010981:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010986:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010992:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.010997:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.011003:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.011008:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.011013:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.011018:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.011023:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.013735:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9d6fd0447400:6524] 0 exiting: rc = 1 00000100:00100000:1.0:1787380417.014067:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9d6fc3a6f200:6525] 1 exiting: rc = 0 00000100:00100000:2.0:1787380417.014302:0:14176:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9d6fd2edf800:14176] 2 exiting: rc = 0 00000100:00100000:3.0:1787380417.015409:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015422:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015430:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015439:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015448:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015458:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015466:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015474:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015482:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015490:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015499:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015508:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015530:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015535:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015549:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015554:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015564:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015570:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015576:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015581:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015587:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015592:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015598:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015603:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015608:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015613:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015663:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015669:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015675:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015679:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015684:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015689:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015694:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015700:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015705:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015710:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015782:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015789:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015795:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.015801:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016032:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016040:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016045:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016050:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016055:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016060:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016065:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016078:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016084:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016091:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016099:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016105:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016113:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016120:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016127:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016134:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016141:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016151:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016163:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016171:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016296:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016306:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016313:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016321:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.016945:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9d6feb660800:6526] 0 exiting: rc = 1 00000100:00100000:1.0:1787380417.017189:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9d6fe7857a00:6527] 1 exiting: rc = 0 00000100:00100000:1.0:1787380417.017258:0:13003:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9d6ec3ca5a00:13003] 2 exiting: rc = 0 00000100:00100000:3.0:1787380417.017357:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017365:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017372:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017378:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017384:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017389:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017401:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017407:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017413:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017419:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017425:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017431:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017437:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017443:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017448:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017453:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017461:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017477:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017496:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017502:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017508:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017513:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017519:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017524:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017529:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017535:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017540:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017545:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017550:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017555:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017574:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017580:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017585:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017591:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017597:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017602:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017608:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017613:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017630:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017636:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017642:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017649:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017670:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017676:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017682:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017688:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017693:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017698:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017703:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017709:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017726:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017734:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017746:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017752:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017772:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017779:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017785:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017791:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017798:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017805:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.017848:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.018067:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.018085:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.018103:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380417.029689:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9d6fd1650400:6529] 1 exiting: rc = 0 00000100:00100000:2.0:1787380417.030048:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9d6fd1650a00:6528] 0 exiting: rc = 1 00000100:00100000:3.0:1787380417.030151:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030159:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030165:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030172:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030295:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030305:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030312:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030318:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030325:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030331:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030338:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030345:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030352:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030358:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030365:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030371:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030377:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030383:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030389:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030394:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030401:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030407:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030412:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030429:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030435:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030440:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030446:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030451:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030457:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030467:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030477:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030487:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030493:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030499:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030504:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030516:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030523:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030577:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030586:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030595:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030601:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030608:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030626:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030633:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030640:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030647:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030654:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030661:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030668:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030675:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030683:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030690:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030697:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030704:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030711:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030731:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030742:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030751:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030765:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.030775:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.031153:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.031165:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.031171:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.031300:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.033260:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9d6feb56a800:6530] 0 exiting: rc = 1 00000100:00100000:1.0:1787380417.033474:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9d6feb56a200:6531] 1 exiting: rc = 0 00000100:00100000:3.0:1787380417.033603:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.033663:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.033673:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.033679:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.033687:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.033695:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.033702:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.033709:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034031:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034040:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034046:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034051:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034056:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034061:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034066:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034072:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034076:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034081:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034086:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034090:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034095:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034101:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034106:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034113:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034120:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034125:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034131:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034138:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034155:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034160:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034167:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034174:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034244:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034256:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034265:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034273:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034281:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034288:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034296:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034303:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034306:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034310:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034314:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034318:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034327:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034388:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034396:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034403:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034410:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034417:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034425:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034431:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034439:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034446:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034453:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034459:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034466:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034472:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034479:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034484:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034491:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034496:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034503:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.034517:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380417.035691:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9d6feb56ae00:6532] 0 exiting: rc = 1 00000100:00100000:1.0:1787380417.036676:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9d6fc923a400:6533] 1 exiting: rc = 0 00000100:00100000:3.0:1787380417.037091:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037100:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037106:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037111:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037118:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037123:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037128:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037135:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037142:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037148:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037155:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037160:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037166:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037173:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037247:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037258:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037263:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037268:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037273:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037277:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037334:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037342:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037349:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037356:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037362:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037368:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037430:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037437:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037443:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037450:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037456:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037462:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037468:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037474:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037492:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037499:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037509:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037518:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037523:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037527:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037531:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037541:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037548:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037553:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037558:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037562:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037567:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037572:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037576:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037581:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037585:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037641:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037651:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037657:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037664:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037671:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037678:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037684:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037690:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037698:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037705:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037711:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037784:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.037795:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380417.038944:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9d6fc923a200:6534] 0 exiting: rc = 1 00000100:00100000:3.0:1787380417.039324:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9d6fc923b000:6536] 2 exiting: rc = 0 00000100:00100000:2.0:1787380417.039628:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9d6fc923b800:6535] 1 exiting: rc = 0 00000100:00100000:3.0:1787380417.040014:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040022:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040028:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040033:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040047:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040053:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040059:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040087:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040095:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040102:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040110:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040118:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040125:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040131:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040139:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040146:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040154:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040161:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040170:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040247:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040317:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040327:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040334:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040342:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040349:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040355:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040363:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040437:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040444:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040455:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040466:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040495:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040503:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040557:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040567:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040575:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040583:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040590:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040598:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040613:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040630:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040637:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040645:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040652:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040659:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040666:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040673:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040681:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040688:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040695:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040702:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040709:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040951:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040959:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040966:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.040995:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.041004:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.041011:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.041018:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.041024:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.041029:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.041034:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.041040:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380417.041047:0:15411:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787380417.047358:0:15411:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787380417.047381:0:15411:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787380417.047387:0:15411:0:(genops.c:906:class_export_put()) final put ffff9d6ff3dac800/MDS_uuid 00000020:00000080:0.0:1787380417.047392:0:15411:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff3dac800/MDS_uuid for MDS 00000020:01000000:0.0:1787380417.047407:0:15411:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787380417.047540:0:15411:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1787380417.612483:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787380418.190297:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c1e31f5e-7395-4c34-a795-7159073dc2a2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787380418.190307:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c1e31f5e-7395-4c34-a795-7159073dc2a2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787380418.190309:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787380418.190312:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787380418.190316:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2381800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787380418.190323:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 423 00000100:00080000:1.0:1787380418.190329:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787380418.190335:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d6ec2381800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:1.0:1787380418.190376:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3f8f480 x1874203867510912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787380418.190417:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787380418.190421:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787380418.190423:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2625000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787380418.190426:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 423 00000100:00080000:1.0:1787380418.190429:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787380418.190432:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d6ec2625000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:1.0:1787380418.190442:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3f8c380 x1874203867511168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787380418.191034:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1874203867510912:0@lo:38:kworker.0 00000400:00000100:1.0:1787380418.191080:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874203867510912 offset 0 length 520: 4 00000100:00100000:1.0:1787380418.191118:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1874203867511168:0@lo:38:kworker.0 00000400:00000100:1.0:1787380418.191133:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874203867511168 offset 0 length 520: 4 00000100:00100000:0.0:1787380418.191581:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867511296:0@lo:400:kworker.0 00000400:00000100:0.0:1787380418.191625:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874203867511296 offset 0 length 224: 4 00000100:00100000:0.0:1787380418.191651:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380418.191659:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867511040:0@lo:400:kworker.0 00000400:00000100:0.0:1787380418.191680:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874203867511040 offset 0 length 224: 4 00010000:00010000:3.0:1787380418.636318:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380419.666521:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380420.688333:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787380420.759120:0:15612:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787380420.775557:0:15612:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787380420.775678:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68d35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d3c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.775693:0:15612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68d35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68d3c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.775701:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68d35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68d3c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.775708:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68d35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68d3c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380420.775727:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787380420.775732:0:15612:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787380420.775753:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787380420.775764:0:15612:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ec3f8f480 x1874203867510912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787380438 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380420.775786:0:15612:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787380420.775791:0:15612:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787380420.775797:0:15612:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2381800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787380420.775801:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:3.0:1787380420.775825:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380420.775832:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68d35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68d3c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380420.775838:0:15612:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ec3f8f480 x1874203867510912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787380438 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787380420.775840:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9ac00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380420.775844:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68d35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68d3c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380420.775846:0:15612:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787380420.775850:0:15612:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00010000:00010000:3.0:1787380420.775861:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68d35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3c46fdcad68d3c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380420.775869:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68d35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3c46fdcad68d3c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380420.775874:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787380420.775877:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787380420.775879:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787380420.775892:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d6ff3dab800 00010000:00010000:3.0:1787380420.775896:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68d35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3c46fdcad68d3c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.775901:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ac00/0xcf3c46fdcad68d35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3c46fdcad68d3c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380420.775912:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380420.775913:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380420.775915:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380420.777130:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1874203867510912:0@lo:38:kworker.0 00000100:00080000:1.0:1787380420.783252:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787380420.783268:0:15612:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ec3f8df80 x1874203867511040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380434 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380420.783285:0:15612:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787380420.783291:0:15612:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787380420.783313:0:15612:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2385800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787380420.789184:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867511040:0@lo:400:kworker.0 00000100:00100000:3.0:1787380420.789387:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1874203867511424:0@lo:39:umount.0 00000400:00000100:3.0:1787380420.789435:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874203867511424 offset 0 length 224: 4 00010000:00010000:2.0:1787380421.708237:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787380422.219921:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c1e31f5e-7395-4c34-a795-7159073dc2a2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787380422.219932:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c1e31f5e-7395-4c34-a795-7159073dc2a2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787380422.219934:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787380422.219937:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787380422.220343:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867511552:0@lo:400:kworker.0 00000400:00000100:2.0:1787380422.220396:0:3639:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874203867511552 offset 0 length 224: 4 00010000:00010000:2.0:1787380422.732017:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787380422.804858:0:9514:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787380422.804868:0:9514:0:(genops.c:906:class_export_put()) final put ffff9d6ec2755000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1787380422.805089:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec2755000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1787380422.805143:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec2752800 for lustre-OST0001 00000001:00100000:2.0:1787380422.805305:0:8429:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787380422.805310:0:8429:0:(genops.c:906:class_export_put()) final put ffff9d6ec2385000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787380422.805451:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec2385000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787380422.805477:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec2382000 for lustre-OST0000 00000100:00080000:0.0:1787380423.243983:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c1e31f5e-7395-4c34-a795-7159073dc2a2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787380423.243998:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c1e31f5e-7395-4c34-a795-7159073dc2a2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787380423.244001:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787380423.244004:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787380423.244288:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380423.244310:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867511680:0@lo:400:kworker.0 00000400:00000100:2.0:1787380423.244363:0:3639:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874203867511680 offset 0 length 224: 4 00010000:00010000:3.0:1787380423.756524:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380424.782061:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380425.806707:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380426.827982:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380426.956482:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380416/real 1787380416] req@ffff9d6ec3cb0380 x1874203867510784/t0(0) o250->MGC192.168.206.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787380426 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380426.956523:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ec3cb0380 x1874203867510784/t0(0) o250->MGC192.168.206.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787380426 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787380426.956541:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ff3dab800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787380426.956574:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787380426.956578:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1e31f5e-7395-4c34-a795-7159073dc2a2:3638:1874203867510784:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1787380426.956617:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c1e31f5e-7395-4c34-a795-7159073dc2a2->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787380426.956623:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787380426.956626:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d6ff3dab800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787380426.956631:0:37:0:(import.c:510:import_select_connection()) MGC192.168.206.130@tcp: connect to NID 0@lo last attempt 427 00000100:00080000:2.0:1787380426.956636:0:37:0:(import.c:589:import_select_connection()) MGC192.168.206.130@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787380426.956644:0:37:0:(import.c:624:import_select_connection()) MGC192.168.206.130@tcp: import ffff9d6ff3dab800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:2.0:1787380426.956676:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3cb3100 x1874203867511808/t0(0) o250->MGC192.168.206.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787380426.956703:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787380426.956706:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787380426.956855:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1e31f5e-7395-4c34-a795-7159073dc2a2:3638:1874203867511808:0@lo:250:kworker.0 00000100:00100000:3.0:1787380426.956864:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867511936:0@lo:400:kworker.0 00000400:00000100:1.0:1787380426.956906:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874203867511808 offset 0 length 520: 4 00000400:00000100:3.0:1787380426.961522:0:3641:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874203867511936 offset 0 length 224: 4 00010000:00010000:2.0:1787380427.853483:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380428.878702:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380429.899971:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380430.028196:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380420/real 1787380420] req@ffff9d6ec3f8f480 x1874203867511424/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787380430 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380430.028247:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ec3f8f480 x1874203867511424/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787380430 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787380430.028266:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2385800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787380430.028282:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1874203867511424:0@lo:39:umount.0 00000100:00080000:0.0:1787380430.028824:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787380430.028829:0:15612:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787380430.028835:0:15612:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787380430.029675:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68d43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d4a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380430.029689:0:15612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68d43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68d4a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380430.029697:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68d43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68d4a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380430.029704:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68d43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68d4a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380430.029970:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787380430.029979:0:15612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9be00/0xcf3c46fdcad68fb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68fc0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380430.030003:0:15612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9be00/0xcf3c46fdcad68fb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68fc0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380430.030009:0:15612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9be00/0xcf3c46fdcad68fb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68fc0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380430.030015:0:15612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9be00/0xcf3c46fdcad68fb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68fc0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380430.032491:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787380430.032505:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68d43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68d4a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380430.032516:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fda200 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:2.0:1787380430.032520:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68d43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68d4a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380430.032529:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68d43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3c46fdcad68d4a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380430.032537:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68d43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3c46fdcad68d4a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380430.032543:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787380430.032556:0:8451:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1787380430.032569:0:8451:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d6ff3dab800 00010000:00010000:2.0:1787380430.032573:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68d43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3c46fdcad68d4a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380430.032579:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ff5fda200/0xcf3c46fdcad68d43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3c46fdcad68d4a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380430.032594:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380430.032598:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9be00/0xcf3c46fdcad68fb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68fc0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380430.032603:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9be00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:2.0:1787380430.032606:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9be00/0xcf3c46fdcad68fb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68fc0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380430.032632:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9be00/0xcf3c46fdcad68fb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3c46fdcad68fc0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787380430.032637:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9be00/0xcf3c46fdcad68fb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3c46fdcad68fc0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380430.032642:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787380430.032644:0:8451:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787380430.032649:0:8451:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d6ff3dab800 00010000:00010000:2.0:1787380430.032652:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9be00/0xcf3c46fdcad68fb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3c46fdcad68fc0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380430.032659:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380430.032661:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380430.032663:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380430.033374:0:15612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787380430.033383:0:15612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9be00/0xcf3c46fdcad68fb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3c46fdcad68fc0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380430.033396:0:15612:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1787380430.033402:0:15612:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1787380430.033415:0:15612:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787380430.033444:0:15612:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787380430.033448:0:15612:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787380430.033454:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787380430.033459:0:15612:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787380430.033463:0:15612:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9d6ffc95b380) has no exports 00000020:00080000:0.0:1787380430.033485:0:15612:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9d6ffc95b380) has no exports 00000020:01000000:0.0:1787380430.035173:0:15612:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d6ec346ba80 - data ffff9d6fdfb200d8/ffff9d6ff5ef8c00 00000020:01000000:0.0:1787380430.035323:0:15612:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d6ec2588c00 - data ffff9d6fdfa81d80/ffff9d6fef75ac00 00010000:00010000:2.0:1787380430.039098:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787380430.049324:0:15612:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787380430.063262:0:15612:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68a87 00000020:00000080:1.0:1787380430.063275:0:15612:0:(genops.c:906:class_export_put()) final put ffff9d6fc4387000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1787380430.064038:0:15612:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6ff5cad800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1787380430.064044:0:15612:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6ff5cad800 2 00000020:01000004:1.0:1787380430.064048:0:15612:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d6ff5cad800 from lustre-OST0000 00000020:00000080:1.0:1787380430.064073:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787380430.064082:0:15612:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1787380430.064086:0:15612:0:(genops.c:906:class_export_put()) final put ffff9d6fc4383800/lustre-OST0000_UUID 00000020:00000080:1.0:1787380430.064089:0:15612:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc4383800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1787380430.064096:0:15612:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1787380430.064162:0:15612:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1787380430.064166:0:15612:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1787380430.064169:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787380430.064174:0:15612:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787380430.064180:0:15612:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9d6ec20b8800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787380430.064186:0:15612:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9d6ffb90b380) has exports, disconnecting them 00000020:00080000:1.0:1787380430.064190:0:15612:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9d6ec20b8800), last request at 1787380200 00000020:00000080:1.0:1787380430.064194:0:15612:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68ab1 00000020:00080000:1.0:1787380430.064205:0:15612:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d6ec20b8800): rc 0 00000020:00000080:1.0:1787380430.064209:0:15612:0:(genops.c:906:class_export_put()) final put ffff9d6ec20b8800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787380430.064254:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc4387000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787380430.066046:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec20b8800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787380430.066078:0:15612:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787380430.066082:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787380430.066086:0:15612:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787380430.066092:0:15612:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787380430.066241:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787380430.066248:0:15612:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1787380430.066254:0:15612:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787380430.066258:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787380430.066262:0:15612:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787380430.066268:0:15612:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9d6ffc7f3800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787380430.066650:0:15612:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff9d6ffb908000) has exports, disconnecting them 00000020:00080000:2.0:1787380430.066656:0:15612:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9d6ffc7f3800), last request at 1787380201 00000020:00000080:2.0:1787380430.066659:0:15612:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68ac6 00000020:00080000:2.0:1787380430.066675:0:15612:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d6ffc7f3800): rc 0 00000020:00000080:2.0:1787380430.066680:0:15612:0:(genops.c:906:class_export_put()) final put ffff9d6ffc7f3800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787380430.066741:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec2381800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787380430.066748:0:37:0:(genops.c:906:class_export_put()) final put ffff9d6ec2384800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787380430.066750:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec2384800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787380430.066761:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787380430.068082:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ffc7f3800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1787380430.068113:0:15612:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787380430.068118:0:15612:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787380430.068122:0:15612:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787380430.068127:0:15612:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787380430.068144:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec2385800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787380430.068270:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787380430.068277:0:15612:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1787380430.068282:0:15612:0:(genops.c:906:class_export_put()) final put ffff9d6ec2382800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1787380430.068284:0:15612:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec2382800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1787380430.068289:0:15612:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1787380430.068348:0:15612:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6ff5cad800 1 00000020:00000080:3.0:1787380430.068353:0:15612:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68a4f 00000020:00000080:3.0:1787380430.068358:0:15612:0:(genops.c:906:class_export_put()) final put ffff9d6fc479e000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787380430.068366:0:15612:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787380430.068373:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc479e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787380430.068382:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787380430.068385:0:15612:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787380430.068389:0:15612:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9d6ffc73b380) has no exports 00000020:00000080:2.0:1787380430.168690:0:15612:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787380430.168705:0:15612:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787380430.168710:0:15612:0:(genops.c:906:class_export_put()) final put ffff9d6ff5cac800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787380430.168715:0:15612:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff5cac800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787380430.168731:0:15612:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787380430.169598:0:15612:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d6ff5caf800 00000020:02000400:2.0:1787380430.169647:0:15612:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787380430.925009:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380431.948583:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787380432.012133:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c1e31f5e-7395-4c34-a795-7159073dc2a2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787380432.012143:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c1e31f5e-7395-4c34-a795-7159073dc2a2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787380432.012147:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787380432.012164:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787380432.012259:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867512064:0@lo:400:kworker.0 00000400:00000100:2.0:1787380432.012322:0:3642:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874203867512064 offset 0 length 224: 4 00010000:00010000:3.0:1787380432.977011:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787380433.731890:0:15814:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787380433.773104:0:15814:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787380433.773194:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68d19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380433.773209:0:15814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68d19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68d20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380433.773218:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68d19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68d20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380433.773225:0:15814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68d19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68d20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380433.773241:0:15814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787380433.773245:0:15814:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787380433.773268:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787380433.773291:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ec3f8c380 x1874203867511168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787380438 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380433.773310:0:15814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787380433.773316:0:15814:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787380433.773322:0:15814:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2625000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787380433.773327:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787380433.773331:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ec3f8c380 x1874203867511168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787380438 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380433.773338:0:15814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787380433.773341:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:1.0:1787380433.773392:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1874203867511168:0@lo:38:kworker.0 00000100:00080000:1.0:1787380433.774299:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787380433.774308:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ec3f8c000 x1874203867511296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380434 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380433.774339:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ec3f8df80 x1874203867511552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380438 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380433.774350:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6fc43e8380 x1874203867511680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380439 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380433.774358:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ec3cb0380 x1874203867511936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380442 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380433.774367:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6fc43e9880 x1874203867512064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380448 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380433.774375:0:15814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787380433.774378:0:15814:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787380433.774397:0:15814:0:(import.c:65:import_set_state_nolock()) ffff9d6ec30ea000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787380433.774426:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1874203867512192:0@lo:39:umount.0 00000400:00000100:1.0:1787380433.774469:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874203867512192 offset 0 length 224: 4 00000100:00100000:1.0:1787380433.774563:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867511936:0@lo:400:kworker.0 00000100:00100000:1.0:1787380433.774584:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867512064:0@lo:400:kworker.0 00000100:00100000:1.0:1787380433.774590:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867511296:0@lo:400:kworker.0 00010000:00010000:0.0:1787380433.775042:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380433.775051:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68d19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68d20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380433.775061:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165bc00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:0.0:1787380433.775065:0:6509:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68d19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68d20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380433.775075:0:6509:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68d19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3c46fdcad68d20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380433.775083:0:6509:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68d19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3c46fdcad68d20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380433.775089:0:6509:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787380433.775092:0:6509:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787380433.775095:0:6509:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787380433.775107:0:6509:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d6ff3dab800 00010000:00010000:0.0:1787380433.775111:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68d19 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3c46fdcad68d20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380433.775117:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fc165bc00/0xcf3c46fdcad68d19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3c46fdcad68d20 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380433.775129:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380433.775131:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380433.775133:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380433.775149:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867511680:0@lo:400:kworker.0 00000100:00100000:0.0:1787380433.775168:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867511552:0@lo:400:kworker.0 00010000:00010000:1.0:1787380433.997486:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380435.020192:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380436.044722:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380437.068048:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787380437.132750:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c1e31f5e-7395-4c34-a795-7159073dc2a2->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787380437.132760:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c1e31f5e-7395-4c34-a795-7159073dc2a2->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787380438.092080:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380439.116014:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380440.140069:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380441.163970:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380441.995927:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380426/real 1787380426] req@ffff9d6ec3cb3100 x1874203867511808/t0(0) o250->MGC192.168.206.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787380441 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380441.995969:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ec3cb3100 x1874203867511808/t0(0) o250->MGC192.168.206.130@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787380441 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787380441.996021:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ff3dab800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787380441.996045:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787380441.996049:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1e31f5e-7395-4c34-a795-7159073dc2a2:3638:1874203867511808:0@lo:250:kworker.0 00000100:00080000:2.0:1787380441.998471:0:13734:0:(pinger.c:229:ptlrpc_pinger_process_import()) c1e31f5e-7395-4c34-a795-7159073dc2a2->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787380441.998490:0:13734:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787380441.998493:0:13734:0:(import.c:65:import_set_state_nolock()) ffff9d6ff3dab800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787380441.998500:0:13734:0:(import.c:510:import_select_connection()) MGC192.168.206.130@tcp: connect to NID 0@lo last attempt 437 00000100:00080000:2.0:1787380441.998506:0:13734:0:(import.c:589:import_select_connection()) MGC192.168.206.130@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787380441.998512:0:13734:0:(import.c:624:import_select_connection()) MGC192.168.206.130@tcp: import ffff9d6ff3dab800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:2.0:1787380441.998545:0:13734:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3cb0a80 x1874203867512320/t0(0) o250->MGC192.168.206.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787380441.998663:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1e31f5e-7395-4c34-a795-7159073dc2a2:3638:1874203867512320:0@lo:250:kworker.0 00000400:00000100:1.0:1787380441.998706:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874203867512320 offset 0 length 520: 4 00010000:00010000:0.0:1787380442.189884:0:6509:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380443.020038:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380433/real 1787380433] req@ffff9d6ec3f8c380 x1874203867512192/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787380443 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380443.020068:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ec3f8c380 x1874203867512192/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787380443 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787380443.020096:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec30ea000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787380443.020129:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1874203867512192:0@lo:39:umount.0 00000100:00080000:2.0:1787380443.020321:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787380443.020325:0:15814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787380443.020345:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787380443.023553:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68d27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68d2e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380443.023572:0:15814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68d27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68d2e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380443.023580:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68d27 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68d2e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380443.023587:0:15814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68d27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68d2e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380443.023670:0:15814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787380443.023679:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47e00/0xcf3c46fdcad68fab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad68fb2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380443.023687:0:15814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47e00/0xcf3c46fdcad68fab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad68fb2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380443.023693:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47e00/0xcf3c46fdcad68fab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68fb2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380443.023698:0:15814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47e00/0xcf3c46fdcad68fab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcf3c46fdcad68fb2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380443.025721:0:15814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787380443.025788:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:2.0:1787380443.025867:0:15814:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787380443.026000:0:15814:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787380443.026005:0:15814:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787380443.026013:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787380443.026031:0:15814:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787380443.026035:0:15814:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff9d6ff4c619c0) has no exports 00000020:00080000:2.0:1787380443.026071:0:15814:0:(genops.c:1579:class_disconnect_exports()) OBD device 24 (ffff9d6ff4c619c0) has no exports 00010000:00010000:1.0:1787380443.027383:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68d27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68d2e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380443.027398:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fc165b800 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:1.0:1787380443.027403:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68d27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68d2e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380443.027412:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68d27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3c46fdcad68d2e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380443.027420:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68d27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3c46fdcad68d2e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380443.027444:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787380443.027447:0:8451:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787380443.027450:0:8451:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787380443.027466:0:8451:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d6ff3dab800 00010000:00010000:1.0:1787380443.027471:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68d27 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3c46fdcad68d2e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380443.027673:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fc165b800/0xcf3c46fdcad68d27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3c46fdcad68d2e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380443.027689:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380443.027693:0:8451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47e00/0xcf3c46fdcad68fab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68fb2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380443.027698:0:8451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47e00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:1.0:1787380443.027701:0:8451:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47e00/0xcf3c46fdcad68fab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcf3c46fdcad68fb2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380443.027708:0:8451:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47e00/0xcf3c46fdcad68fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3c46fdcad68fb2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380443.027718:0:8451:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47e00/0xcf3c46fdcad68fab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3c46fdcad68fb2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380443.027723:0:8451:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787380443.027726:0:8451:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787380443.027728:0:8451:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787380443.027735:0:8451:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d6ff3dab800 00010000:00010000:1.0:1787380443.027743:0:8451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47e00/0xcf3c46fdcad68fab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3c46fdcad68fb2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380443.027756:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d47e00/0xcf3c46fdcad68fab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3c46fdcad68fb2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380443.027769:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380443.027770:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380443.027772:0:8451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380443.029873:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787380443.040012:0:15814:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d6ec346b240 - data ffff9d6fdfb1d288/ffff9d6ff5efb800 00000020:01000000:2.0:1787380443.040292:0:15814:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9d6ec346bd20 - data ffff9d6fdfa78af8/ffff9d6ec34fb800 00100000:10000000:2.0:1787380443.052121:0:15814:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787380443.068635:0:15814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68bad 00000020:00000080:0.0:1787380443.068650:0:15814:0:(genops.c:906:class_export_put()) final put ffff9d6fcff5a800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787380443.068671:0:15814:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6fff5a3000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787380443.068675:0:15814:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6fff5a3000 2 00000020:01000004:0.0:1787380443.068679:0:15814:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9d6fff5a3000 from lustre-OST0001 00000020:00000080:2.0:1787380443.068698:0:13734:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fcff5a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787380443.068715:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787380443.068726:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787380443.068729:0:15814:0:(genops.c:906:class_export_put()) final put ffff9d6ec2624800/lustre-OST0001_UUID 00000020:00000080:0.0:1787380443.068732:0:15814:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec2624800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787380443.068738:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787380443.068911:0:15814:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c1e31f5e-7395-4c34-a795-7159073dc2a2->MGS 00010000:00010000:0.0:1787380443.068926:0:15814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031200/0xcf3c46fdcad68906 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3c46fdcad6890d expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380443.068940:0:15814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031200/0xcf3c46fdcad68906 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3c46fdcad6890d expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380443.068947:0:15814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787380443.068950:0:15814:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787380443.068953:0:15814:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787380443.068974:0:15814:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d6ff3dab800 00010000:00010000:0.0:1787380443.068978:0:15814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fc0031200/0xcf3c46fdcad68906 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3c46fdcad6890d expref: -99 pid: 7451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380443.068996:0:15814:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46e00/0xcf3c46fdcad68d89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcf3c46fdcad68d90 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380443.069017:0:15814:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46e00/0xcf3c46fdcad68d89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcf3c46fdcad68d90 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380443.069023:0:15814:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787380443.069025:0:15814:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787380443.069027:0:15814:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787380443.069042:0:15814:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9d6ff3dab800 00010000:00010000:0.0:1787380443.069050:0:15814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ff5d46e00/0xcf3c46fdcad68d89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcf3c46fdcad68d90 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787380443.069067:0:15814:0:(import.c:65:import_set_state_nolock()) ffff9d6ff3dab800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787380443.069071:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787380443.069073:0:15814:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787380443.069075:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787380443.069079:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787380443.069088:0:15814:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9d6ec3cb0a80 x1874203867512320/t0(0) o250->MGC192.168.206.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787380461 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787380443.069110:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787380443.069113:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:1.0:1787380443.069189:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1e31f5e-7395-4c34-a795-7159073dc2a2:3638:1874203867512320:0@lo:250:kworker.0 10000000:01000000:0.0:1787380443.070793:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787380443.070822:0:15814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68803 00000020:00000080:0.0:1787380443.070831:0:15814:0:(genops.c:906:class_export_put()) final put ffff9d6ff3da8000/c1e31f5e-7395-4c34-a795-7159073dc2a2 00000020:01000000:0.0:1787380443.070843:0:15814:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.206.130@tcp (flags='') 00000020:00000080:0.0:1787380443.070849:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787380443.070855:0:15814:0:(obd_config.c:955:class_cleanup()) MGC192.168.206.130@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787380443.070858:0:15814:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9d6ff8828000) has no exports 00000020:00000080:2.0:1787380443.070986:0:13734:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff3da8000/c1e31f5e-7395-4c34-a795-7159073dc2a2 for MGC192.168.206.130@tcp 10000000:01000000:2.0:1787380443.071999:0:6518:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1787380443.073883:0:15814:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.206.130@tcp: client import never connected 00000100:00080000:0.0:1787380443.073891:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787380443.073894:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787380443.073899:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787380443.073914:0:15814:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787380443.073970:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787380443.073979:0:15814:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.130@tcp (uuid c1e31f5e-7395-4c34-a795-7159073dc2a2) 00000020:01000000:0.0:1787380443.073987:0:15814:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787380443.073992:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787380443.073997:0:15814:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787380443.074004:0:15814:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9d6ec2620800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787380443.074011:0:15814:0:(genops.c:1574:class_disconnect_exports()) OBD device 25 (ffff9d6ffc73cd40) has exports, disconnecting them 00000020:00080000:0.0:1787380443.074016:0:15814:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9d6ec2620800), last request at 1787380221 00000020:00000080:0.0:1787380443.074020:0:15814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68bd7 00000020:00080000:0.0:1787380443.074034:0:15814:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d6ec2620800): rc 0 00000020:00000080:0.0:1787380443.074039:0:15814:0:(genops.c:906:class_export_put()) final put ffff9d6ec2620800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787380443.074140:0:13734:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ff3dab800 for MGC192.168.206.130@tcp 00000020:00000080:2.0:1787380443.074151:0:13734:0:(genops.c:906:class_export_put()) final put ffff9d6ff3dab000/c1e31f5e-7395-4c34-a795-7159073dc2a2 00000020:00000080:2.0:1787380443.074154:0:13734:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ff3dab000/c1e31f5e-7395-4c34-a795-7159073dc2a2 for MGC192.168.206.130@tcp 00000020:01000000:2.0:1787380443.074162:0:13734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.130@tcp (c1e31f5e-7395-4c34-a795-7159073dc2a2) 00000020:00000080:2.0:1787380443.074944:0:13734:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec2620800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787380443.078866:0:15814:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787380443.078874:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787380443.078877:0:15814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787380443.078884:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787380443.079031:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787380443.079040:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1787380443.079047:0:15814:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787380443.079051:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787380443.079056:0:15814:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787380443.079062:0:15814:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9d6ec30eb000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787380443.079068:0:15814:0:(genops.c:1574:class_disconnect_exports()) OBD device 26 (ffff9d6ec34f19c0) has exports, disconnecting them 00000020:00080000:0.0:1787380443.079072:0:15814:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9d6ec30eb000), last request at 1787380221 00000020:00000080:0.0:1787380443.079076:0:15814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68bec 00000020:00080000:0.0:1787380443.079090:0:15814:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9d6ec30eb000): rc 0 00000020:00000080:0.0:1787380443.079094:0:15814:0:(genops.c:906:class_export_put()) final put ffff9d6ec30eb000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1787380443.079762:0:13734:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec2625000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787380443.079770:0:13734:0:(genops.c:906:class_export_put()) final put ffff9d6ec2751800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787380443.079773:0:13734:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec2751800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787380443.079783:0:13734:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787380443.079859:0:13734:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec30eb000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1787380443.086149:0:15814:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787380443.086158:0:15814:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787380443.086162:0:15814:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787380443.086169:0:15814:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787380443.086197:0:13734:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9d6ec30ea000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1787380443.086260:0:6509:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787380443.086399:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787380443.122907:0:8451:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787380443.123103:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9d6fc90eaa00:6504] 0 exiting: rc = 1 00000100:00100000:2.0:1787380443.123176:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9d6fd165e200:6505] 1 exiting: rc = 0 00000100:00100000:0.0:1787380443.124962:0:8450:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9d6ec2058200:8450] 2 exiting: rc = 0 00000100:00100000:2.0:1787380443.131872:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.132176:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9d6fc90eac00:6507] 1 exiting: rc = 0 00000100:00100000:0.0:1787380443.132841:0:6508:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9d6fc90eb800:6508] 2 exiting: rc = 0 00000100:00100000:2.0:1787380443.132972:0:10339:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9d6ec25c3000:10339] 3 exiting: rc = 0 00000100:00100000:2.0:1787380443.134015:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9d6fc90ea000:6506] 0 exiting: rc = 1 00000100:00100000:2.0:1787380443.134089:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134097:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134107:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134114:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134120:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134126:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134132:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134138:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134144:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134149:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134155:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134160:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134166:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134173:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134179:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134186:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134191:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134197:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134202:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134208:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134214:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134219:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134225:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134230:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134301:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134308:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134313:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134318:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134323:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134338:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134343:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134348:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134352:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134357:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134361:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134366:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134371:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134642:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134651:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134657:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134662:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134667:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134672:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134677:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134683:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134687:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134692:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134697:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134701:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134706:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134711:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134716:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134720:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134725:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134730:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134734:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134739:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134743:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134748:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134752:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134757:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134769:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134775:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.134780:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787380443.136077:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787380443.136086:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1787380443.136091:0:15814:0:(genops.c:906:class_export_put()) final put ffff9d6ec2621800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1787380443.136095:0:15814:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec2621800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1787380443.136100:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1787380443.136148:0:15814:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6fff5a3000 1 00000020:00000080:2.0:1787380443.136153:0:15814:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xcf3c46fdcad68b7c 00000020:00000080:2.0:1787380443.136158:0:15814:0:(genops.c:906:class_export_put()) final put ffff9d6ec20b9000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1787380443.136168:0:15814:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1787380443.136178:0:13734:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6ec20b9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787380443.136188:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787380443.136192:0:15814:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787380443.136195:0:15814:0:(genops.c:1579:class_disconnect_exports()) OBD device 23 (ffff9d6ffc958000) has no exports 00000020:00000080:2.0:1787380443.296090:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787380443.296103:0:15814:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1787380443.296108:0:15814:0:(genops.c:906:class_export_put()) final put ffff9d6fff5a7000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1787380443.296113:0:15814:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fff5a7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787380443.296119:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1787380443.296424:0:15814:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9d6fff5a7800 00000020:01000000:2.0:1787380443.296451:0:15814:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1787380443.296456:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787380443.296460:0:15814:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787380443.296464:0:15814:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9d6ffc9599c0) has no exports 00000020:00000080:2.0:1787380443.296497:0:15814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787380443.296502:0:15814:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1787380443.296504:0:15814:0:(genops.c:906:class_export_put()) final put ffff9d6fc4798000/OSS_uuid 00000020:00000080:2.0:1787380443.296507:0:15814:0:(genops.c:865:class_export_destroy()) destroying export ffff9d6fc4798000/OSS_uuid for OSS 00000020:01000000:2.0:1787380443.296510:0:15814:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1787380443.296706:0:8871:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9d6ec2389e00:8871] 3 exiting: rc = 0 00000100:00100000:0.0:1787380443.296775:0:12152:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9d6ec37d8c00:12152] 4 exiting: rc = 0 00000100:00100000:1.0:1787380443.296793:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9d6ff5c96600:8435] 1 exiting: rc = 0 00000100:00080000:3.0:1787380443.296932:0:6517:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787380443.298539:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9d6ff3e80600:8433] 0 exiting: rc = 1 00000100:00100000:3.0:1787380443.298648:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9d6ff5c96c00:8436] 2 exiting: rc = 0 00000100:00100000:1.0:1787380443.299128:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299138:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299143:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299158:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299166:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299171:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299176:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299182:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299187:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299192:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299198:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299203:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299208:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299213:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299218:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299224:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299229:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299234:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299240:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299244:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299249:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299266:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299271:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299284:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299290:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299295:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299300:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299304:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299309:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299314:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299319:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299324:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299329:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299335:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299339:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299344:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299348:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299353:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299358:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299363:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299368:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299373:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299378:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299383:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299389:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299393:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299398:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299403:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299408:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299412:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299417:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299422:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299426:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299431:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299435:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299440:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299453:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299458:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299463:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299469:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299486:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299492:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299497:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.299503:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.300192:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9d6ffc5b4200:8438] 1 exiting: rc = 0 00000100:00100000:3.0:1787380443.300919:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9d6ff4ea1e00:8437] 0 exiting: rc = 1 00000100:00100000:0.0:1787380443.301369:0:13810:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9d6ec37d8400:13810] 2 exiting: rc = 0 00000100:00100000:1.0:1787380443.302042:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302051:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302058:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302062:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302067:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302072:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302077:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302082:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302158:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302164:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302169:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302175:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302180:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302185:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302191:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302196:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302201:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302206:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302211:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302215:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302220:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302225:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302230:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302234:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302239:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302244:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302260:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302265:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302270:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302287:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302294:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302299:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302304:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302309:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302313:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302318:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302324:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302329:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302333:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302339:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302343:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302348:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302352:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302356:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302360:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302365:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302397:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302404:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302408:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302413:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302418:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302422:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302427:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302432:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302437:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302442:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302447:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302452:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302457:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302463:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302468:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302492:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302497:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.302506:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787380443.305198:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9d6ff3e80c00:8439] 0 exiting: rc = 1 00000100:00100000:1.0:1787380443.305549:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9d6ff5cd6600:8441] 2 exiting: rc = 0 00000100:00100000:3.0:1787380443.307259:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9d6ff3e81600:8440] 1 exiting: rc = 0 00000100:00100000:0.0:1787380443.308921:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.308930:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.308936:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.308943:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.308949:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.308954:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.308960:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.308965:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.308971:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.308978:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.308987:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.308993:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309002:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309073:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309081:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309086:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309093:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309099:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309160:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309227:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309233:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309241:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309248:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309254:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309259:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309264:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309269:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309293:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309300:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309306:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309311:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309317:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309334:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309341:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309346:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309352:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309357:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309363:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309368:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309373:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309378:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309383:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309389:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309394:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309399:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309405:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309410:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309416:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309421:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309426:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309431:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309445:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309452:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309457:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309463:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309486:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309507:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309513:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309518:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309524:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309530:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309535:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309540:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787380443.309546:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.316301:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9d6fe6ab2600:8443] 1 exiting: rc = 0 00000100:00100000:0.0:1787380443.316596:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9d6fe6ab3400:8442] 0 exiting: rc = 1 00000100:00100000:3.0:1787380443.316930:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.316938:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.316943:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.316949:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317152:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317158:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317163:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317168:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317174:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317179:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317184:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317189:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317194:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317198:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317203:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317208:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317213:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317219:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317224:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317229:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317235:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317308:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317315:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317321:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317326:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317330:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317335:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317340:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317361:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317368:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317376:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317385:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317748:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.317756:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318004:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318015:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318025:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318033:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318042:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318052:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318059:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318066:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318072:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318078:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318089:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318095:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318100:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318105:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318111:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318116:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318121:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318126:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318130:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318135:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318141:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318146:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318151:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318156:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318161:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318166:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318172:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318177:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318181:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.318201:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787380443.319958:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9d6ff4cb6000:8444] 0 exiting: rc = 1 00000100:00100000:1.0:1787380443.319993:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9d6ff4cb6600:8445] 1 exiting: rc = 0 00000100:00100000:1.0:1787380443.320076:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320083:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320089:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320095:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320120:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320132:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320142:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320148:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320154:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320160:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320165:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320170:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320177:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320183:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320188:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320195:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320217:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320224:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320230:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320237:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320244:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320251:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320258:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320264:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320271:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320277:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320283:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320289:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320324:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320331:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320338:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320345:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320351:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320357:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320363:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320369:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320375:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320381:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320386:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320392:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320413:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320421:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320426:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320432:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320438:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320444:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320450:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320456:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320469:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320484:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320490:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320496:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320518:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320525:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320531:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320537:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320544:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320549:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320555:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320560:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320567:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320572:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320578:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787380443.320592:0:15814:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787380443.335524:0:15814:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787380462.912476:0:16579:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787380473.632002:0:17178:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787380473.632009:0:17178:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787380473.632016:0:17178:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787380473.632244:0:17178:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d6ec3e05800 00000020:01000004:2.0:1787380473.632258:0:17178:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787380473.632265:0:17178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787380473.632277:0:17178:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9d6ff4c63380) 00000020:00000080:2.0:1787380473.632289:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787380473.699399:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1787380473.699888:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787380473.700760:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1787380473.701253:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1787380473.702344:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1787380473.704086:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1787380473.704654:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787380473.704921:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1787380473.705249:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787380473.705484:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1787380473.710776:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1787380473.711392:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787380473.712539:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1787380473.712924:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1787380473.714004:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1787380473.722564:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787380473.723083:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787380473.723316:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787380473.724077:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787380473.725643:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1787380473.726273:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787380473.726568:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787380473.726920:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787380473.727385:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787380473.727669:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787380473.728287:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1787380473.728661:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787380473.730205:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787380473.730645:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787380473.731333:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787380473.732054:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787380473.732639:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1787380473.732890:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1787380473.733371:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787380473.733952:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787380473.734388:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1787380473.734722:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787380473.735201:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787380473.735561:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1787380473.735770:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787380473.736243:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1787380473.736473:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787380473.736656:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787380473.737122:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787380473.737399:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787380473.737586:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787380473.737790:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1787380473.741538:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1787380473.742828:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1787380473.743024:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1787380473.743743:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1787380473.744007:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1787380473.744368:0:17178:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:3.0:1787380473.744936:0:17178:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787380473.745328:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787380473.745337:0:17178:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787380473.745349:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3c46fdcad69dc0 00000020:01000004:3.0:1787380473.745356:0:17178:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1787380473.745361:0:17178:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787380473.745366:0:17178:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d6ec3e05800 from MGS 00000020:01000004:3.0:1787380473.745369:0:17178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787380473.745379:0:17178:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9d6ffc95cd40) 00000020:00000080:3.0:1787380473.745392:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787380473.745677:0:17178:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6ec3e05800 from MGS, refs=2 00080000:01000000:3.0:1787380473.745682:0:17178:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787380473.745688:0:17178:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3c46fdcad69dce 00000100:00100000:3.0:1787380473.745789:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787380473.745941:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787380473.745947:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787380473.746707:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787380473.746713:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787380473.752720:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787380473.753113:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787380473.753120:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787380473.753752:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787380473.753761:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787380473.754762:0:17178:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787380473.754772:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787380473.757702:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380473.757707:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380473.757709:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380473.758405:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380473.758408:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380473.758410:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380473.759112:0:17178:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787380473.760142:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787380473.768385:0:17178:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1787380473.773186:0:17191:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787380473.773420:0:17178:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787380473.773466:0:17178:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787380473.775104:0:17178:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787380473.775419:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787380473.775561:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787380473.775567:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787380473.777170:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787380473.777181:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787380473.777567:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787380473.777573:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787380473.778418:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787380473.778438:0:17178:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.130@tcp' 00000020:01000004:1.0:1787380473.778440:0:17178:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787380473.778467:0:17178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.130@tcp (typ=mgc) 00000020:00000080:1.0:1787380473.778478:0:17178:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.130@tcp (ffff9d6ec34f3380) 00000020:00000080:1.0:1787380473.778493:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:3.0:1787380473.778599:0:17195:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:1.0:1787380473.778695:0:17178:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ff88a4800@MGC192.168.206.130@tcp: add connection 192.168.206.130@tcp at head 00010000:00010000:1.0:1787380473.778860:0:17178:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.130@tcp-0 is initialized 00000040:01000000:1.0:1787380473.778866:0:17178:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.130@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787380473.785195:0:17196:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787380473.785267:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.130@tcp (uuid 7d8d387d-7e15-4118-9d7b-f7697dc8c103) 00000020:00000080:2.0:1787380473.785291:0:17178:0:(genops.c:1406:class_connect()) connect: client 7d8d387d-7e15-4118-9d7b-f7697dc8c103, cookie 0xcf3c46fdcad69ddc 00000100:00080000:2.0:1787380473.785302:0:17178:0:(import.c:510:import_select_connection()) MGC192.168.206.130@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787380473.785320:0:17178:0:(import.c:624:import_select_connection()) MGC192.168.206.130@tcp: import ffff9d6ff88a4800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:2.0:1787380473.785352:0:17178:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3cb0000 x1874203867512448/t0(0) o250->MGC192.168.206.130@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787380473.785374:0:17178:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7d8d387d-7e15-4118-9d7b-f7697dc8c103->MGS 00000020:01000004:2.0:1787380473.785394:0:17178:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787380473.785417:0:17178:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787380473.785430:0:17178:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9d6ff4c64d40) 00000020:00000080:2.0:1787380473.785444:0:17178:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787380473.796721:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3638:1874203867512448:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787380473.796787:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380473.799288:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867512448 00000100:00100000:1.0:1787380473.799302:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867512448 00000100:00100000:1.0:1787380473.799355:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380473.799364:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3638:x1874203867512448:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787380473.799390:0:17192:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 7d8d387d-7e15-4118-9d7b-f7697dc8c103@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:1.0:1787380473.799419:0:17192:0:(genops.c:1406:class_connect()) connect: client 7d8d387d-7e15-4118-9d7b-f7697dc8c103, cookie 0xcf3c46fdcad69dea 00000100:00080000:1.0:1787380473.799531:0:17192:0:(import.c:65:import_set_state_nolock()) ffff9d6ff88a4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380473.799609:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+5:3638:x1874203867512448:12345-0@lo:250:mount.lustre.0 Request processed in 245us (2820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380473.799616:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380473.799675:0:3638:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.206.130@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1787380473.799684:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.130@tcp: connect to target with instance 0 00000100:00080000:1.0:1787380473.799691:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.130@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1787380473.799696:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1787380473.799699:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ff88a4800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1787380473.799702:0:3638:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1787380473.799712:0:3638:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1787380473.799717:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3638:1874203867512448:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787380473.802240:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787380473.802413:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787380473.802419:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787380473.803489:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787380473.803497:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787380473.810348:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787380473.810359:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787380473.811221:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787380473.811388:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787380473.811394:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787380473.811847:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787380473.811854:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787380473.861766:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787380473.862688:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787380473.862697:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787380473.864651:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787380473.864662:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787380473.865542:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787380473.865694:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787380473.865700:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787380473.869438:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787380473.869450:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787380473.871949:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787380473.872127:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787380473.872133:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787380473.873048:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787380473.873116:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787380473.875275:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787380473.875632:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787380473.875637:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787380473.883434:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787380473.883447:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787380473.910057:0:17178:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787380473.910993:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787380473.911000:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787380473.920610:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787380473.920624:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787380473.928736:0:17178:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787380473.928754:0:17178:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787380473.930614:0:17178:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787380473.930646:0:17178:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787380473.930652:0:17178:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.130@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787380473.930946:0:17178:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787380473.930982:0:17178:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.130@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787380473.930986:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787380473.930987:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787380473.930989:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380473.930990:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380473.930991:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380473.930992:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380473.930994:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787380473.930995:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787380473.930997:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380473.930998:0:17178:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787380473.931001:0:17178:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787380473.931003:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787380473.931004:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787380473.931005:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380473.931006:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380473.931007:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380473.931008:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380473.931015:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787380473.931015:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787380473.931016:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380473.931017:0:17178:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787380473.931041:0:17178:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787380473.931059:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867512576:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787380473.931121:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380473.931184:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd8315c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787380473.931247:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867512576 00000100:00100000:1.0:1787380473.931254:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867512576 00000100:00100000:1.0:1787380473.931303:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787380473.931323:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+5:17178:x1874203867512576:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787380473.931369:0:17194:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787380473.931373:0:17194:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787380473.931392:0:17194:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1787380473.933254:0:17215:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787380473.936508:0:17194:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1787380473.949677:0:17216:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787380473.949685:0:17216:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1787380473.949705:0:17216:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787380473.949709:0:17216:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787380473.954557:0:17216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1787380473.956974:0:17194:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787380473.956986:0:17194:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787380473.961068:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+5:17178:x1874203867512576:12345-0@lo:253:mount.lustre.0 Request processed in 29729us (29927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380473.961082:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787380473.962253:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867512576:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787380473.962270:0:17178:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787380473.962273:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787380473.962274:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787380473.962276:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380473.962277:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380473.962278:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380473.962279:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380473.962280:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787380473.962282:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787380473.962283:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380473.962285:0:17178:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787380473.962323:0:17178:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d6ec3e05800 from lustre-MDT0000 10000000:01000000:2.0:1787380473.962354:0:17178:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787380473.962356:0:17178:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787380473.962360:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9d6ec34f3380 10000000:01000000:2.0:1787380473.962364:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787380473.962371:0:17178:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9d6ec34f3380 from 1 10000000:01000000:2.0:1787380473.962374:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787380473.962408:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69df1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380473.962419:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69df1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380473.962445:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69df1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380473.962464:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867512704:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787380473.962513:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380473.962553:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd8315180 going to sleep for 11 seconds 00000100:00100000:3.0:1787380473.962568:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867512704 00000100:00100000:3.0:1787380473.962574:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867512704 00000100:00100000:3.0:1787380473.962624:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380473.962632:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+5:17178:x1874203867512704:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787380473.962644:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380473.962658:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89c800/0xcf3c46fdcad69df8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad69df1 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380473.962680:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89c800/0xcf3c46fdcad69df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad69df1 expref: 6 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380473.962689:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89c800/0xcf3c46fdcad69df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69df1 expref: 6 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380473.962698:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89c800, rc 0) 00000100:00100000:3.0:1787380473.962744:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+6:17178:x1874203867512704:12345-0@lo:101:mount.lustre.0 Request processed in 113us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380473.962751:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787380473.962774:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867512704:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787380473.962787:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69df1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69df8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380473.962796:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69df1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad69df8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380473.962864:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867512832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380473.962888:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380473.962917:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3378540 going to sleep for 11 seconds 00000100:00100000:1.0:1787380473.962978:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867512832 00000100:00100000:1.0:1787380473.962983:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867512832 00000100:00100000:1.0:1787380473.963016:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787380473.963024:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+6:17178:x1874203867512832:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380473.963099:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+6:17178:x1874203867512832:12345-0@lo:501:mount.lustre.0 Request processed in 76us (209us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787380473.963106:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787380473.963175:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867512832:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787380473.963200:0:17178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787380473.963217:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69df1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69df8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380473.963226:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69df1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69df8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380473.963233:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d6ec3e05800 10000000:01000000:0.0:1787380473.963241:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787380473.963245:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d6ec3e05800 10000000:01000000:0.0:1787380473.963247:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787380473.963250:0:17178:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9d6ec3e05800 from 1 10000000:01000000:0.0:1787380473.963252:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787380473.963269:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866400/0xcf3c46fdcad69dff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380473.963289:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866400/0xcf3c46fdcad69dff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380473.963299:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866400/0xcf3c46fdcad69dff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380473.963321:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867512960:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787380473.963347:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380473.963367:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3378540 going to sleep for 11 seconds 00000100:00100000:3.0:1787380473.963417:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867512960 00000100:00100000:3.0:1787380473.963422:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867512960 00000100:00100000:3.0:1787380473.963451:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787380473.963458:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+6:17178:x1874203867512960:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787380473.963465:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380473.963474:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89da00/0xcf3c46fdcad69e06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad69dff expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380473.963489:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89da00/0xcf3c46fdcad69e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad69dff expref: 7 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380473.963504:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89da00/0xcf3c46fdcad69e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69dff expref: 7 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380473.963512:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89da00, rc 0) 00000100:00100000:3.0:1787380473.963547:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+7:17178:x1874203867512960:12345-0@lo:101:mount.lustre.0 Request processed in 90us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380473.963553:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787380473.963619:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867512960:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787380473.963628:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866400/0xcf3c46fdcad69dff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69e06 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380473.963635:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866400/0xcf3c46fdcad69dff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad69e06 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380473.963645:0:17178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787380473.963648:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866400/0xcf3c46fdcad69dff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69e06 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380473.963654:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866400/0xcf3c46fdcad69dff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69e06 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380473.963659:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787380473.963662:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787380473.963666:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d6ec3e05800 10000000:01000000:0.0:1787380473.963669:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787380473.963676:0:17178:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787380473.963678:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787380473.963692:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867c00/0xcf3c46fdcad69e0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380473.963699:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867c00/0xcf3c46fdcad69e0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380473.963705:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867c00/0xcf3c46fdcad69e0d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380473.963718:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867513088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787380473.963742:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380473.963766:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3378540 going to sleep for 11 seconds 00000100:00100000:2.0:1787380473.963789:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867513088 00000100:00100000:2.0:1787380473.963794:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867513088 00000100:00100000:2.0:1787380473.963843:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787380473.963850:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+7:17178:x1874203867513088:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787380473.963857:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380473.963865:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fd0d0f000/0xcf3c46fdcad69e14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad69e0d expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380473.963878:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fd0d0f000/0xcf3c46fdcad69e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad69e0d expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380473.963886:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fd0d0f000/0xcf3c46fdcad69e14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69e0d expref: 8 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380473.963892:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0f000, rc 0) 00000100:00100000:2.0:1787380473.963940:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+8:17178:x1874203867513088:12345-0@lo:101:mount.lustre.0 Request processed in 82us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380473.963946:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787380473.964016:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867513088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787380473.964026:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867c00/0xcf3c46fdcad69e0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69e14 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380473.964034:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867c00/0xcf3c46fdcad69e0d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad69e14 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380473.964085:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867513216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380473.964121:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380473.964144:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3378540 going to sleep for 11 seconds 00000100:00100000:3.0:1787380473.964208:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867513216 00000100:00100000:3.0:1787380473.964212:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867513216 00000100:00100000:3.0:1787380473.964241:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787380473.964247:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+8:17178:x1874203867513216:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787380473.964389:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+9:17178:x1874203867513216:12345-0@lo:501:mount.lustre.0 Request processed in 142us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380473.964396:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787380473.964486:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867513216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380473.964525:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867513344:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787380473.964563:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380473.964590:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3378540 going to sleep for 11 seconds 00000100:00100000:3.0:1787380473.964667:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867513344 00000100:00100000:3.0:1787380473.964673:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867513344 00000100:00100000:3.0:1787380473.964709:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787380473.964716:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+9:17178:x1874203867513344:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787380473.966417:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+9:17178:x1874203867513344:12345-0@lo:503:mount.lustre.0 Request processed in 1694us (1846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380473.966428:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787380473.966686:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867513344:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787380473.968606:0:17217:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17217:1874203867513472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380473.968678:0:17217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380473.968722:0:17217:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3378900 going to sleep for 11 seconds 00000100:00100000:1.0:1787380473.968734:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867513472 00000100:00100000:1.0:1787380473.968741:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867513472 00000100:00100000:1.0:1787380473.968791:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787380473.968800:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+9:17217:x1874203867513472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380473.973405:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+9:17217:x1874203867513472:12345-0@lo:502:llog_process_th.0 Request processed in 4596us (4717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380473.973424:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787380473.973650:0:17217:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17217:1874203867513472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787380473.973684:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380473.973695:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380473.973697:0:17217:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787380473.973703:0:17217:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787380473.973714:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787380473.973728:0:17217:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9d6ffc9599c0) 00000020:00000080:3.0:1787380473.973745:0:17217:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787380473.973751:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787380473.973867:0:17217:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787380473.973876:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3c46fdcad69e22 00000020:00000080:3.0:1787380473.974088:0:17217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787380473.974093:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380473.974097:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380473.974098:0:17217:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787380473.974106:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380473.974110:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380473.974112:0:17217:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787380473.974115:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787380473.974122:0:17217:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9d6ffc958000) 00000020:00000080:3.0:1787380473.974131:0:17217:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787380473.974135:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787380473.974137:0:17217:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787380473.974140:0:17217:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787380473.974145:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787380473.974188:0:17217:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6ec3e05800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787380473.974199:0:17217:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9d6ffc95b380) 00000020:00000080:3.0:1787380473.974206:0:17217:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1787380473.974272:0:17217:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1787380473.974278:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3c46fdcad69e37 00000020:00000080:3.0:1787380473.974522:0:17217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1787380473.974529:0:17217:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1787380473.974534:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcf3c46fdcad69e3e 00080000:01000000:3.0:1787380473.974538:0:17217:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787380473.974541:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3c46fdcad69e45 00010000:00010000:2.0:1787380474.064264:0:17217:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787380474.064906:0:17217:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1787380474.065197:0:17217:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787380474.065684:0:17217:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9d6ff4c619c0) 00000020:00000080:2.0:1787380474.065701:0:17217:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787380474.065760:0:17217:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787380474.065767:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3c46fdcad69e53 00000020:00000080:2.0:1787380474.066435:0:17217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787380474.069175:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcf3c46fdcad69e5a 00000020:00000080:0.0:1787380474.070992:0:17217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787380474.071004:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380474.071011:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380474.071013:0:17217:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787380474.071016:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787380474.071019:0:17217:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1787380474.071020:0:17217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787380474.071022:0:17217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787380474.071023:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787380474.071026:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380474.071028:0:17217:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787380474.071030:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380474.071035:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380474.071036:0:17217:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787380474.071040:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787380474.071108:0:17217:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787380474.071127:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380474.071131:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380474.071132:0:17217:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787380474.071135:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380474.071138:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380474.071139:0:17217:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787380474.071142:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787380474.071147:0:17217:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.130@tcp to nid 0x20000c0a8ce82 (192.168.206.130@tcp) 00000020:00000080:0.0:1787380474.071171:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787380474.071185:0:17217:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9d6ff5f64d40) 00000020:00000080:0.0:1787380474.071200:0:17217:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787380474.071214:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787380474.071271:0:17217:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787380474.071276:0:17217:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787380474.071283:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3c46fdcad69e68 00010000:00080000:0.0:1787380474.071334:0:17217:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ec3d45000@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.130@tcp at head 00010000:00010000:0.0:1787380474.072970:0:17217:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1787380474.074690:0:17217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787380474.074705:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787380474.074741:0:17217:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787380474.074762:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3c46fdcad69e6f 00000100:00080000:2.0:1787380474.074771:0:17217:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787380474.074777:0:17217:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d6ec3d45000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:2.0:1787380474.074853:0:17217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3cb1180 x1874203867513600/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787380474.074872:0:17217:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1787380474.074931:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380474.074935:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380474.074937:0:17217:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1787380474.074940:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787380474.074942:0:17217:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1787380474.074944:0:17217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787380474.074945:0:17217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787380474.074947:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787380474.074949:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380474.074950:0:17217:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787380474.074952:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787380474.074956:0:17217:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1787380474.074959:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380474.074961:0:17217:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787380474.074963:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787380474.074967:0:17217:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.130@tcp to nid 0x20000c0a8ce82 (192.168.206.130@tcp) 00000020:01000000:2.0:1787380474.074991:0:17217:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787380474.074993:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787380474.075004:0:17217:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9d6ff4c60000) 00000020:00000080:2.0:1787380474.075014:0:17217:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787380474.075018:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1787380474.075159:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867513600:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787380474.075216:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380474.075282:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867513600 00000100:00100000:1.0:1787380474.075288:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867513600 00000100:00100000:1.0:1787380474.075325:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380474.075331:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1874203867513600:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1787380474.075345:0:17204:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787380474.075401:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1874203867513600:12345-0@lo:38:llog_process_th.0 Request processed in 67us (184us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787380474.075409:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787380474.075444:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3d45000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787380474.075449:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787380474.075452:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867513600:0@lo:38:llog_process_th.0 00000004:00080000:2.0:1787380474.075524:0:17217:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787380474.075530:0:17217:0:(osd_handler.c:8929:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787380474.075537:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3c46fdcad69e7d 00010000:00080000:2.0:1787380474.075563:0:17217:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6fd1713000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.130@tcp at head 00010000:00010000:2.0:1787380474.075771:0:17217:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787380474.081285:0:17217:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787380474.081529:0:17217:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787380474.086207:0:17217:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787380474.086398:0:17217:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787380474.089668:0:17217:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787380474.090709:0:17223:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787380474.090715:0:17223:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787380474.091497:0:17217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787380474.091510:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787380474.091548:0:17217:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787380474.091569:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3c46fdcad69e84 00000100:00080000:1.0:1787380474.091578:0:17217:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787380474.091584:0:17217:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d6fd1713000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:1.0:1787380474.091616:0:17217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3f8ed80 x1874203867513728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787380474.091644:0:17217:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787380474.091698:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380474.091702:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380474.091704:0:17217:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787380474.091706:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787380474.091709:0:17217:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1787380474.091711:0:17217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787380474.091713:0:17217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787380474.091714:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787380474.091716:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380474.091717:0:17217:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787380474.091719:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787380474.091724:0:17217:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787380474.091734:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380474.091736:0:17217:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787380474.091739:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787380474.091743:0:17217:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.130@tcp to nid 0x20000c0a8ce82 (192.168.206.130@tcp) 00000020:01000000:1.0:1787380474.091764:0:17217:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787380474.091767:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787380474.091778:0:17217:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9d6ec34f0000) 00000020:00000080:1.0:1787380474.091791:0:17217:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1787380474.091795:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787380474.091882:0:17217:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787380474.091887:0:17217:0:(osd_handler.c:8929:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787380474.091905:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcf3c46fdcad69e92 00010000:00080000:1.0:1787380474.091933:0:17217:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ec231e000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.130@tcp at head 00010000:00010000:1.0:1787380474.092127:0:17217:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787380474.092188:0:17217:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787380474.092201:0:17217:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1787380474.092851:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867513728:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787380474.092918:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874203867513728 offset 0 length 520: 4 00000040:00080000:1.0:1787380474.094321:0:17217:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380474.094519:0:17217:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787380474.094655:0:17217:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787380474.095647:0:17225:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787380474.095653:0:17225:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787380474.096441:0:17217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787380474.096453:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787380474.096485:0:17217:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787380474.096503:0:17217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3c46fdcad69e99 00000100:00080000:1.0:1787380474.096512:0:17217:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787380474.096517:0:17217:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d6ec231e000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:1.0:1787380474.096549:0:17217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3f8ea00 x1874203867513856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787380474.096609:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867513856:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787380474.096659:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874203867513856 offset 0 length 520: 4 00000100:00080000:1.0:1787380474.096712:0:17217:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787380474.096837:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380474.096842:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380474.096850:0:17217:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787380474.096854:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380474.096858:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380474.096859:0:17217:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787380474.096862:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787380474.096864:0:17217:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787380474.096866:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380474.096868:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380474.096869:0:17217:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787380474.096871:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380474.096873:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380474.096874:0:17217:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787380474.096877:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787380474.096905:0:17217:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17217:1874203867513984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380474.096950:0:17217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380474.096969:0:17217:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5d58600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380474.097265:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867513984 00000100:00100000:3.0:1787380474.097273:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867513984 00000100:00100000:3.0:1787380474.097323:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787380474.097331:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+9:17217:x1874203867513984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380474.097453:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+9:17217:x1874203867513984:12345-0@lo:502:llog_process_th.0 Request processed in 122us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380474.097461:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787380474.097551:0:17217:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17217:1874203867513984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787380474.097576:0:17217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380474.097581:0:17217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380474.097582:0:17217:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787380474.097586:0:17217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1787380474.097772:0:17178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1787380474.097791:0:17178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787380474.097832:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867c00/0xcf3c46fdcad69e0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69e14 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380474.097843:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867c00/0xcf3c46fdcad69e0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69e14 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380474.097850:0:17178:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6ec3e05800 from 1 10000000:01000000:3.0:1787380474.097852:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787380474.097879:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad69ea0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380474.097887:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad69ea0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380474.097895:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad69ea0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380474.097910:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867514112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787380474.097949:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380474.097974:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd0019900 going to sleep for 11 seconds 00000100:00100000:2.0:1787380474.098093:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867514112 00000100:00100000:2.0:1787380474.098098:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867514112 00000100:00100000:2.0:1787380474.098128:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787380474.098135:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+9:17178:x1874203867514112:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787380474.098144:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380474.098156:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ea7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad69ea0 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380474.098189:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad69ea0 expref: 10 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380474.098198:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69ea0 expref: 10 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380474.098206:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0f400, rc 0) 00000100:00100000:2.0:1787380474.098237:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+10:17178:x1874203867514112:12345-0@lo:101:mount.lustre.0 Request processed in 103us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380474.098243:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787380474.098374:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e30a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867514112:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380474.098387:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad69ea0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69ea7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.098396:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad69ea0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad69ea7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380474.098962:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867514240:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787380474.099002:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380474.099031:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5d58e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380474.099154:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867514240 00000100:00100000:3.0:1787380474.099159:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867514240 00000100:00100000:3.0:1787380474.099196:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787380474.099204:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+10:17178:x1874203867514240:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787380474.099219:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787380474.099224:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787380474.099284:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+10:17178:x1874203867514240:12345-0@lo:256:mount.lustre.0 Request processed in 81us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380474.099291:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787380474.099456:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867514240:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787380474.100121:0:17178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787380474.100138:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad69ea0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69ea7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.100174:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad69ea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69ea7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380474.100181:0:17178:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ec3e05800 from 1 10000000:01000000:1.0:1787380474.100184:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787380474.100212:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad69eae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.100219:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad69eae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.100227:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad69eae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380474.100243:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867514368:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787380474.100278:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380474.100425:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5d58e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380474.100521:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867514368 00000100:00100000:3.0:1787380474.100527:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867514368 00000100:00100000:3.0:1787380474.100596:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787380474.100605:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+10:17178:x1874203867514368:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787380474.100616:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380474.100628:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89ce00/0xcf3c46fdcad69eb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad69eae expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380474.100647:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89ce00/0xcf3c46fdcad69eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad69eae expref: 11 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380474.100656:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89ce00/0xcf3c46fdcad69eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69eae expref: 11 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380474.100665:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89ce00, rc 0) 00000100:00100000:3.0:1787380474.100706:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+11:17178:x1874203867514368:12345-0@lo:101:mount.lustre.0 Request processed in 102us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380474.100724:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787380474.100792:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867514368:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380474.100804:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad69eae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69eb5 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.100842:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad69eae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad69eb5 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380474.100898:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867514496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380474.100925:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380474.101228:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5d58e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787380474.101316:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867514496 00000100:00100000:2.0:1787380474.101321:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867514496 00000100:00100000:2.0:1787380474.101346:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787380474.101352:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+11:17178:x1874203867514496:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380474.101487:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+11:17178:x1874203867514496:12345-0@lo:501:mount.lustre.0 Request processed in 134us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380474.101495:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787380474.101565:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867514496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380474.101595:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867514624:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787380474.101633:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380474.101655:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5d58e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787380474.101702:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867514624 00000100:00100000:2.0:1787380474.101706:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867514624 00000100:00100000:2.0:1787380474.101724:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787380474.101729:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+11:17178:x1874203867514624:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787380474.101828:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+11:17178:x1874203867514624:12345-0@lo:503:mount.lustre.0 Request processed in 77us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380474.101835:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787380474.101911:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867514624:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787380474.102217:0:17227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17227:1874203867514752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380474.102251:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380474.102271:0:17227:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5d58600 going to sleep for 11 seconds 00000100:00100000:2.0:1787380474.102323:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867514752 00000100:00100000:2.0:1787380474.102328:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867514752 00000100:00100000:2.0:1787380474.102353:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787380474.102359:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+11:17227:x1874203867514752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787380474.102728:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+11:17227:x1874203867514752:12345-0@lo:502:llog_process_th.0 Request processed in 367us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380474.102735:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787380474.102843:0:17227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17227:1874203867514752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787380474.102866:0:17227:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380474.102875:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380474.102877:0:17227:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787380474.102883:0:17227:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6ec3e05800 00000020:00000080:1.0:1787380474.102886:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787380474.102893:0:17227:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380474.102895:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380474.102896:0:17227:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787380474.102898:0:17227:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380474.102900:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380474.102901:0:17227:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787380474.102904:0:17227:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6ec3e05800 00000020:00000080:1.0:1787380474.102906:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787380474.102961:0:17227:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380474.102965:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380474.102967:0:17227:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787380474.102969:0:17227:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380474.102972:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380474.102973:0:17227:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787380474.102976:0:17227:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6ec3e05800 00000020:00000080:1.0:1787380474.102985:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787380474.103004:0:17227:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380474.103007:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380474.103008:0:17227:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787380474.103010:0:17227:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380474.103012:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380474.103013:0:17227:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787380474.103016:0:17227:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6ec3e05800 00000020:00000080:1.0:1787380474.103018:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787380474.103055:0:17227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17227:1874203867514880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380474.103150:0:17227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380474.103165:0:17227:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff5d58600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380474.106159:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867514880 00000100:00100000:3.0:1787380474.106172:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867514880 00000100:00100000:1.0:1787380474.106325:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787380474.106336:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff63a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+11:17227:x1874203867514880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787380474.106493:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff63a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+11:17227:x1874203867514880:12345-0@lo:502:llog_process_th.0 Request processed in 159us (3341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380474.106500:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787380474.106607:0:17227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17227:1874203867514880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787380474.106638:0:17227:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380474.106645:0:17227:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380474.106647:0:17227:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787380474.106651:0:17227:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787380474.106804:0:17178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787380474.106857:0:17178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787380474.106871:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad69eae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69eb5 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.106882:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad69eae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69eb5 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380474.106930:0:17178:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787380474.106933:0:17178:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d6ec3e05800 10000000:01000000:1.0:1787380474.106935:0:17178:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d6ec3e05800 10000000:01000000:1.0:1787380474.106939:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787380474.106950:0:17178:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6ec3e05800 from 1 10000000:01000000:1.0:1787380474.106952:0:17178:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787380474.106979:0:17178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0400/0xcf3c46fdcad69ebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.106986:0:17178:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0400/0xcf3c46fdcad69ebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.106994:0:17178:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0400/0xcf3c46fdcad69ebc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380474.107011:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867515008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787380474.107042:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380474.107198:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd2415780 going to sleep for 11 seconds 00000100:00100000:1.0:1787380474.107226:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867515008 00000100:00100000:1.0:1787380474.107230:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867515008 00000100:00100000:1.0:1787380474.107249:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787380474.107255:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff63ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+11:17178:x1874203867515008:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380474.107264:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380474.107277:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ec3df1c00/0xcf3c46fdcad69ec3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad69ebc expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.107297:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ec3df1c00/0xcf3c46fdcad69ec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad69ebc expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.107316:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ec3df1c00/0xcf3c46fdcad69ec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69ebc expref: 12 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.107325:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df1c00, rc 0) 00000100:00100000:1.0:1787380474.107363:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff63ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17178:x1874203867515008:12345-0@lo:101:mount.lustre.0 Request processed in 108us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380474.107375:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787380474.107448:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867515008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787380474.107460:0:17178:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0400/0xcf3c46fdcad69ebc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69ec3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380474.107469:0:17178:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0400/0xcf3c46fdcad69ebc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad69ec3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380474.107517:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867515136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787380474.107543:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380474.107565:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd00199c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380474.107870:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867515136 00000100:00100000:3.0:1787380474.107875:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867515136 00000100:00100000:3.0:1787380474.107896:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787380474.107902:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17178:x1874203867515136:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787380474.108006:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17178:x1874203867515136:12345-0@lo:501:mount.lustre.0 Request processed in 103us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380474.108012:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787380474.108045:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867515136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787380474.108092:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867515264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787380474.108128:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380474.108141:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd00199c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380474.108153:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867515264 00000100:00100000:3.0:1787380474.108156:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867515264 00000100:00100000:3.0:1787380474.108173:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787380474.108179:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff63a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17178:x1874203867515264:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787380474.108250:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff63a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17178:x1874203867515264:12345-0@lo:503:mount.lustre.0 Request processed in 70us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380474.108257:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787380474.108299:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e32d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867515264:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787380474.121212:0:17230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17230:1874203867515392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380474.121283:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380474.121368:0:17230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec33786c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380474.127385:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867515392 00000100:00100000:3.0:1787380474.127399:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867515392 00000100:00100000:3.0:1787380474.127454:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787380474.127463:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17230:x1874203867515392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787380474.127626:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17230:x1874203867515392:12345-0@lo:502:llog_process_th.0 Request processed in 164us (6342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380474.127634:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787380474.128979:0:17230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17230:1874203867515392:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787380474.129045:0:17230:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787380474.129125:0:17230:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9d6ff5f619c0) 00000020:00000080:0.0:1787380474.129145:0:17230:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1787380474.129372:0:17230:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6ec3e05800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787380474.129377:0:17230:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6ec3e05800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787380474.129380:0:17230:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6ec3e05800 4 00010000:00080000:0.0:1787380474.129407:0:17230:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ec376a800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.130@tcp at head 00010000:00010000:0.0:1787380474.133766:0:17230:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1787380474.134206:0:17230:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787380474.134248:0:17230:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787380474.134259:0:17230:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcf3c46fdcad69ed1 00000100:00080000:0.0:1787380474.134271:0:17230:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787380474.134277:0:17230:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d6ec376a800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1787380474.134338:0:17230:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6fc43e9180 x1874203867515520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787380474.134373:0:17230:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787380474.134415:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874203867515520:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787380474.134478:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380474.135202:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867515520 00000100:00100000:3.0:1787380474.135213:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867515520 00000100:00100000:3.0:1787380474.135258:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787380474.135265:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1874203867515520:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787380474.135335:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1874203867515520:12345-0@lo:38:llog_process_th.0 Request processed in 69us (856us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787380474.135348:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787380474.135384:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787380474.135391:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec376a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787380474.135403:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787380474.135407:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874203867515520:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787380474.139686:0:17230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17230:1874203867515648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380474.139755:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380474.139787:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867515648 00000100:00100000:0.0:1787380474.139793:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867515648 00000100:00100000:0.0:1787380474.139849:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787380474.139858:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17230:x1874203867515648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380474.139954:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17230:x1874203867515648:12345-0@lo:502:llog_process_th.0 Request processed in 97us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380474.139962:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787380474.140001:0:17230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc5321cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380474.140020:0:17230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17230:1874203867515648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380474.140052:0:17230:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17230:1874203867515776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380474.140093:0:17230:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380474.140124:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867515776 00000100:00100000:0.0:1787380474.140128:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867515776 00000100:00100000:0.0:1787380474.140148:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787380474.140154:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff63b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17230:x1874203867515776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787380474.140211:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff63b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17230:x1874203867515776:12345-0@lo:502:llog_process_th.0 Request processed in 55us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380474.140218:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787380474.140245:0:17230:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc7e7f780 going to sleep for 11 seconds 00000100:00100000:0.0:1787380474.140256:0:17230:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17230:1874203867515776:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787380474.140271:0:17230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1787380474.140969:0:17178:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787380474.140992:0:17178:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787380474.141009:0:17178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0400/0xcf3c46fdcad69ebc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69ec3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380474.141020:0:17178:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0400/0xcf3c46fdcad69ebc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69ec3 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787380474.141170:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787380474.141172:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787380474.141173:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787380474.141175:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787380474.141175:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787380474.141177:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787380474.141178:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787380474.141180:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787380474.141181:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787380474.141182:0:17178:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787380474.141186:0:17178:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1787380474.141188:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787380474.141189:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787380474.141190:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787380474.141191:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787380474.141192:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787380474.141194:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787380474.141195:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787380474.141196:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787380474.141197:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787380474.141203:0:17178:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787380474.141219:0:17178:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787380474.141232:0:17178:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e31880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867515904:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787380474.141270:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380474.141298:0:17178:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956540 going to sleep for 11 seconds 00000100:00100000:3.0:1787380474.141370:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867515904 00000100:00100000:3.0:1787380474.141375:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867515904 00000100:00100000:3.0:1787380474.141409:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787380474.141415:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17178:x1874203867515904:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787380474.141436:0:17193:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787380474.141448:0:17193:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787380474.155769:0:17193:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787380474.155837:0:17193:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787380474.156215:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17178:x1874203867515904:12345-0@lo:253:mount.lustre.0 Request processed in 14796us (14941us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380474.156227:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787380474.156351:0:17178:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e31880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17178:1874203867515904:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787380474.156363:0:17178:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787380474.156367:0:17178:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787380474.156368:0:17178:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787380474.156370:0:17178:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380474.156371:0:17178:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380474.156372:0:17178:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380474.156373:0:17178:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380474.156375:0:17178:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787380474.156376:0:17178:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787380474.156378:0:17178:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380474.156379:0:17178:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787380474.156393:0:17178:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1787380474.164691:0:17215:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787380474.164699:0:17215:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787380474.164719:0:17215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ed8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380474.164737:0:17215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ea7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69ea0 expref: 11 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380474.164745:0:17215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ed8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380474.164785:0:17215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad69ea0 expref: 11 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380474.164801:0:17215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ea7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad69ea0 expref: 11 pid: 17194 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380474.165013:0:17215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1874203867516032:0@lo:104: 00000100:00100000:2.0:1787380474.165281:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380474.165355:0:17215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec33786c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380474.165428:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867516032 00000100:00100000:3.0:1787380474.165434:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867516032 00000100:00100000:3.0:1787380474.165469:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787380474.165477:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+3:17215:x1874203867516032:12345-0@lo:104: 00010000:00010000:3.0:1787380474.165488:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad69ea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad69ea7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380474.165558:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787380474.165565:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+3:17215:x1874203867516032:12345-0@lo:104: Request processed in 88us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380474.165573:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380474.165791:0:17215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb2a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1874203867516032:0@lo:104: 00010000:00010000:2.0:1787380474.165870:0:17215:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ed8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380474.171934:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380474.171945:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad69ea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad69ea7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380474.171962:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d000 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:0.0:1787380474.171966:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad69ea0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad69ea7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380474.171974:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad69ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad69ea7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380474.171981:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad69ea0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad69ea7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380474.171986:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787380474.172025:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad69ea0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69ea7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380474.172032:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380474.172051:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad69ea0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69ea7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380474.172058:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d000/0xcf3c46fdcad69ea0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69ea7 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380474.172072:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380474.172074:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380474.172075:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380474.172114:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3639:1874203867516160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380474.172170:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380474.172697:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867516160 00000100:00100000:1.0:1787380474.172705:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867516160 00010000:00010000:1.0:1787380474.172729:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ea7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad69ea0 expref: 12 pid: 17194 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380474.172766:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380474.172775:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:3639:x1874203867516160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380474.172799:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380474.172830:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ea7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad69ea0 expref: 12 pid: 17194 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.172844:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad69ea0 expref: 12 pid: 17194 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.172859:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ea7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad69ea0 expref: 12 pid: 17194 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.172882:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ed8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.172890:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ed8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787380474.172904:0:17184:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008205876s 00010000:00010000:1.0:1787380474.172908:0:17184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ed8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.172915:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ed8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.172922:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ed8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.172928:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ed8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.172933:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0ec00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380474.172937:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ed8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.172945:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ed8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.172960:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ed8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380474.172970:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380474.173417:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3639:1874203867516160:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787380474.173497:0:17215:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ed8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380474.173511:0:17215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ed8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380474.173516:0:17215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ed8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380474.173557:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+11:3639:x1874203867516160:12345-0@lo:103:ldlm_bl.0 Request processed in 783us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380474.173565:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00080000:2.0:1787380474.182251:0:17178:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787380474.182523:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787380474.182833:0:17239:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787380474.182967:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1787380474.183367:0:17239:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1787380474.184354:0:17240:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9d6ff4e33480 x1874203867516288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380474.184375:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00000040:01000000:0.0:1787380474.184789:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787380474.184871:0:17178:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787380474.186760:0:17178:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787380474.186779:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787380474.186863:0:17178:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1787380474.188336:0:17238:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787380474.188344:0:17238:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1787380474.189051:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787380474.189298:0:17239:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787380474.189367:0:17239:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1787380474.190288:0:17178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787380474.190335:0:17178:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1787380474.191793:0:17178:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1787380474.194691:0:17178:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787380474.196755:0:17178:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787380474.196790:0:17178:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb3a801913988 00100000:10000000:0.0:1787380474.196797:0:17178:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787380474.197879:0:17178:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787380474.197895:0:17178:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.130@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787380474.197911:0:17178:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787380474.197927:0:17178:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1787380474.203937:0:17178:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787380474.204117:0:17178:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787380474.765700:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787380474.892256:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787380474.892265:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6ec3e05800 from 7 10000000:01000000:0.0:1787380474.892270:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787380474.892326:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad69edf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380474.892337:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad69edf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380474.892346:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad69edf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380474.892370:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867516416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787380474.892433:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380474.892521:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fb9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787380474.892788:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867516416 00000100:00100000:3.0:1787380474.892796:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867516416 00000100:00100000:3.0:1787380474.892867:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787380474.892876:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff63a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+11:17196:x1874203867516416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380474.892888:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380474.892901:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad69ee6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad69edf expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380474.892923:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad69ee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad69edf expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380474.892933:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad69ee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69edf expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380474.892942:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89d800, rc 0) 00000100:00100000:3.0:1787380474.892991:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff63a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17196:x1874203867516416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380474.892998:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787380474.893096:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867516416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380474.893111:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad69edf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69ee6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380474.893120:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad69edf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad69ee6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380474.893171:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867516544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787380474.893204:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380474.893230:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd2501300 going to sleep for 11 seconds 00000100:00100000:0.0:1787380474.893413:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867516544 00000100:00100000:0.0:1787380474.893418:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867516544 00000100:00100000:0.0:1787380474.893453:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787380474.893460:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff63b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17196:x1874203867516544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787380474.893474:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787380474.893490:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787380474.893493:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787380474.893570:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff63b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17196:x1874203867516544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380474.893577:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787380474.894195:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867516544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787380474.894245:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787380474.894253:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad69edf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69ee6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380474.894272:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad69edf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69ee6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787380475.153337:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787380475.211900:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00010000:00010000:2.0:1787380475.788205:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787380476.173413:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787380476.235969:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00010000:00010000:3.0:1787380476.822057:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380477.267266:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00010000:00010000:0.0:1787380477.835963:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380478.284631:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00010000:00010000:3.0:1787380478.862610:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787380479.054252:0:17483:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787380479.308708:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00000100:00080000:3.0:1787380479.628158:0:13734:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787380479.628177:0:13734:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787380479.628180:0:13734:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3d45000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787380479.628187:0:13734:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 484 00000100:00080000:3.0:1787380479.628193:0:13734:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787380479.628198:0:13734:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d6ec3d45000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1787380479.628218:0:13734:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff4e33b80 x1874203867516800/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787380479.628231:0:13734:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787380479.628234:0:13734:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787380479.628237:0:13734:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787380479.628239:0:13734:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787380479.628242:0:13734:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787380479.628245:0:13734:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787380479.628246:0:13734:0:(import.c:65:import_set_state_nolock()) ffff9d6ec376a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787380479.628250:0:13734:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9d6ec376a800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1787380479.628260:0:13734:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff4e31f80 x1874203867516928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787380479.628299:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3640:1874203867516672:0@lo:400:kworker.0 00000100:00100000:3.0:1787380479.628362:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380479.628541:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867516800:0@lo:38:kworker.0 00000100:00100000:1.0:1787380479.628585:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380479.628674:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867516672 00000100:00100000:3.0:1787380479.628681:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867516672 00000100:00100000:3.0:1787380479.628854:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787380479.628862:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:3640:x1874203867516672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380479.628905:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:3640:x1874203867516672:12345-0@lo:400:kworker.0 Request processed in 43us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380479.628918:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787380479.628961:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3640:1874203867516672:0@lo:400:kworker.0 00000100:00100000:1.0:1787380479.630119:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874203867516928:0@lo:38:kworker.0 00000100:00100000:1.0:1787380479.630163:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380479.630261:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867516928 00000100:00100000:3.0:1787380479.630268:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867516928 00000100:00100000:3.0:1787380479.630309:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787380479.630315:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1874203867516928:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787380479.630338:0:17201:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:3.0:1787380479.630369:0:17201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcf3c46fdcad69eed 00000004:00100000:3.0:1787380479.630383:0:17201:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787380479.630509:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9d6feb617000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787380479.630562:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1874203867516928:12345-0@lo:38:kworker.0 Request processed in 244us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380479.630569:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787380479.630855:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d6ff4e31f80 x1874203867516928/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787380489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787380479.630870:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787380479.630878:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787380479.630883:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787380479.630885:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec376a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787380479.630891:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3638:1874203867516928:0@lo:38:kworker.0 00000100:00100000:2.0:1787380479.631190:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867516800 00000100:00100000:2.0:1787380479.631195:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867516800 00000100:00100000:1.0:1787380479.631332:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787380479.631337:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1874203867516800:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787380479.631350:0:17204:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1787380479.674794:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3d45000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787380479.674804:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787380479.674837:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867516800:0@lo:38:kworker.0 00000100:00100000:1.0:1787380479.674912:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1874203867516800:12345-0@lo:38:kworker.0 Request processed in 43351us (46117us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787380479.674923:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787380479.891495:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787380480.164256:0:17535:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787380480.164445:0:17535:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787380480.336848:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00010000:00010000:3.0:1787380480.908175:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787380481.121949:0:17585:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787380481.122169:0:17585:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787380481.356137:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00010000:00010000:2.0:1787380481.933952:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380482.379914:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00010000:00010000:3.0:1787380482.958558:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380483.406261:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00010000:00010000:2.0:1787380483.980072:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380484.432773:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00000100:00080000:1.0:1787380484.748036:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787380484.748043:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787380484.748047:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3d45000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787380484.748054:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 489 00000100:00080000:1.0:1787380484.748060:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787380484.748067:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d6ec3d45000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:1.0:1787380484.748089:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3f8e680 x1874203867517184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787380484.748105:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787380484.748109:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787380484.748111:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787380484.748114:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787380484.748178:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867517312:0@lo:400:kworker.0 00000100:00100000:1.0:1787380484.748239:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380484.748301:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787380484.748309:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3642:1874203867517056:0@lo:400:kworker.0 00000100:00100000:1.0:1787380484.748344:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380484.748381:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380474/real 1787380474] req@ffff9d6ec3f8ea00 x1874203867513856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380484 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380484.748400:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ec3f8ea00 x1874203867513856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380484 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380484.748424:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380474/real 1787380474] req@ffff9d6ec3f8ed80 x1874203867513728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380484 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380484.748436:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ec3f8ed80 x1874203867513728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380484 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380484.748449:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867517184:0@lo:38:kworker.0 00000100:00100000:1.0:1787380484.748478:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787380484.748498:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec231e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787380484.748509:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787380484.748512:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867513856:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787380484.748518:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6fd1713000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787380484.748522:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787380484.748525:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867513728:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787380484.748564:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867517312 00000100:00100000:1.0:1787380484.748571:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867517312 00000100:00100000:1.0:1787380484.748609:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380484.748618:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867517312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380484.748667:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867517312:12345-0@lo:400:kworker.0 Request processed in 50us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380484.748675:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380484.748703:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867517184 00000100:00100000:1.0:1787380484.748707:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867517184 00000100:00100000:1.0:1787380484.748725:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787380484.748730:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1874203867517184:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787380484.748745:0:17205:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787380484.749436:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867517056 00000100:00100000:3.0:1787380484.749443:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867517056 00000100:00100000:3.0:1787380484.749475:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787380484.749483:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:3642:x1874203867517056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380484.749530:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:3642:x1874203867517056:12345-0@lo:400:kworker.0 Request processed in 48us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380484.749537:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1787380484.755268:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787380484.755277:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787380484.755281:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d6fd1713000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787380484.755295:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 484 00000100:00080000:3.0:1787380484.755300:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787380484.755306:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d6fd1713000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1787380484.755340:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff4e33100 x1874203867517440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787380484.755367:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787380484.755370:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787380484.755372:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d6ec231e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787380484.755375:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 484 00000100:00080000:3.0:1787380484.755378:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787380484.755380:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d6ec231e000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1787380484.755392:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff4e32a00 x1874203867517568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787380484.755427:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867517440:0@lo:8:kworker.0 00000400:00000100:3.0:1787380484.755481:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874203867517440 offset 0 length 520: 4 00000100:00100000:3.0:1787380484.755526:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867517568:0@lo:8:kworker.0 00000400:00000100:3.0:1787380484.755547:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874203867517568 offset 0 length 520: 4 00000100:00100000:3.0:1787380484.755593:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3642:1874203867517056:0@lo:400:kworker.0 00010000:00080000:3.0:1787380484.755608:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d6ec3f8ce00 x1874203867517312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380484.755618:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867517312:0@lo:400:kworker.0 00000100:00100000:1.0:1787380484.783634:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1874203867517184:12345-0@lo:38:kworker.0 Request processed in 34895us (35146us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787380484.783647:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787380484.783797:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3d45000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787380484.783803:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787380484.783835:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867517184:0@lo:38:kworker.0 00010000:00010000:3.0:1787380485.004733:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380485.451923:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00010000:00010000:0.0:1787380486.033526:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787380486.415713:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787380486.476864:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00010000:00010000:3.0:1787380487.055270:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380487.500963:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00010000:00010000:0.0:1787380488.087682:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787380488.267981:0:17930:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787380488.267985:0:17930:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787380488.267986:0:17930:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787380488.268087:0:17930:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d6ff3daa800 00000020:01000004:2.0:1787380488.268101:0:17930:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1787380488.268113:0:17930:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787380488.268126:0:17930:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9d6ffc73cd40) 00000020:00000080:2.0:1787380488.268141:0:17930:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787380488.343463:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1787380488.344290:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787380488.346539:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1787380488.347165:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1787380488.359081:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1787380488.359640:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1787380488.361164:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1787380488.361925:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787380488.362788:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1787380488.363468:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1787380488.364357:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787380488.364927:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787380488.365934:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787380488.366469:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1787380488.367055:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1787380488.367427:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1787380488.368489:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787380488.369283:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1787380488.369710:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787380488.369992:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787380488.370301:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1787380488.370604:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787380488.370956:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1787380488.371394:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787380488.371755:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787380488.372262:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1787380488.372501:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787380488.373719:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787380488.374194:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1787380488.374851:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787380488.375145:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787380488.376756:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787380488.377644:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787380488.377960:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787380488.379955:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787380488.380361:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787380488.381465:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787380488.383168:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1787380488.386267:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787380488.386843:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1787380488.387163:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787380488.387454:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787380488.387798:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1787380488.388254:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787380488.390747:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787380488.391746:0:17930:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1787380488.393924:0:17930:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787380488.394176:0:17930:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1787380488.394187:0:17930:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787380488.394198:0:17930:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf3c46fdcad69efb 00000020:01000004:3.0:1787380488.394204:0:17930:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787380488.394224:0:17930:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.130@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787380488.394238:0:17930:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787380488.394243:0:17930:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1787380488.394270:0:17930:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1787380488.394273:0:17930:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.130@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1787380488.420767:0:17930:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.130@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787380488.423496:0:17930:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.130@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1787380488.423507:0:17930:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787380488.423509:0:17930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787380488.423510:0:17930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380488.423511:0:17930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380488.423513:0:17930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380488.423515:0:17930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380488.423516:0:17930:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787380488.423517:0:17930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380488.423518:0:17930:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787380488.423523:0:17930:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1787380488.423526:0:17930:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787380488.423527:0:17930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787380488.423528:0:17930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380488.423530:0:17930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380488.423546:0:17930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380488.423547:0:17930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380488.423548:0:17930:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787380488.423549:0:17930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380488.423550:0:17930:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787380488.423578:0:17930:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787380488.423600:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867517696:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787380488.423748:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380488.423878:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fb93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380488.425055:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867517696 00000100:00100000:3.0:1787380488.425065:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867517696 00000100:00100000:3.0:1787380488.425176:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787380488.425186:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17930:x1874203867517696:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787380488.425219:0:17194:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787380488.425222:0:17194:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1787380488.425241:0:17194:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787380488.425838:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17930:x1874203867517696:12345-0@lo:253:mount.lustre.0 Request processed in 620us (2055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380488.425848:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787380488.425932:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867517696:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787380488.425943:0:17930:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787380488.425946:0:17930:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787380488.425948:0:17930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787380488.425949:0:17930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380488.425950:0:17930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380488.425952:0:17930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380488.425953:0:17930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380488.425954:0:17930:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787380488.425956:0:17930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380488.425957:0:17930:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787380488.425988:0:17930:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d6ff3daa800 from lustre-MDT0001 10000000:01000000:2.0:1787380488.426018:0:17930:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787380488.426021:0:17930:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787380488.426027:0:17930:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d6ec34f3380 local copy 00010000:00010000:2.0:1787380488.426038:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69df1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69df8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380488.426130:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867517824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380488.426165:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380488.432643:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc52c0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380488.433564:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867517824 00000100:00100000:0.0:1787380488.433575:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867517824 00000100:00100000:0.0:1787380488.433639:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787380488.433649:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17930:x1874203867517824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380488.433777:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17930:x1874203867517824:12345-0@lo:501:mount.lustre.0 Request processed in 130us (7611us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787380488.433784:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787380488.433992:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867517824:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787380488.434015:0:17930:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787380488.434059:0:17930:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787380488.434066:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69df1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69df8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380488.434076:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69df1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69df8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380488.434104:0:17930:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d6ff3daa800 10000000:01000000:2.0:1787380488.434109:0:17930:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787380488.434115:0:17930:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9d6ec34f3380 10000000:01000000:2.0:1787380488.434117:0:17930:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787380488.434120:0:17930:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9d6ec34f3380 from 1 10000000:01000000:2.0:1787380488.434123:0:17930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787380488.434152:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f600/0xcf3c46fdcad69f02 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380488.434161:0:17930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f600/0xcf3c46fdcad69f02 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380488.434170:0:17930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f600/0xcf3c46fdcad69f02 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380488.434187:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867517952:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787380488.434220:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380488.434245:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc52c0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380488.434420:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867517952 00000100:00100000:0.0:1787380488.434426:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867517952 00000100:00100000:0.0:1787380488.434446:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787380488.434453:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+12:17930:x1874203867517952:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787380488.434469:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380488.434483:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7867400/0xcf3c46fdcad69f09 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad69f02 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.434502:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7867400/0xcf3c46fdcad69f09 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad69f02 expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.434511:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7867400/0xcf3c46fdcad69f09 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69f02 expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.434519:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867400, rc 0) 00000100:00100000:0.0:1787380488.434557:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+13:17930:x1874203867517952:12345-0@lo:101:mount.lustre.0 Request processed in 105us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380488.434564:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787380488.434705:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867517952:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787380488.434717:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f600/0xcf3c46fdcad69f02 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69f09 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380488.434725:0:17930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f600/0xcf3c46fdcad69f02 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad69f09 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380488.434747:0:17930:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787380488.434769:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f600/0xcf3c46fdcad69f02 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69f09 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380488.434777:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f600/0xcf3c46fdcad69f02 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69f09 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380488.434784:0:17930:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9d6ff3daa800 10000000:01000000:2.0:1787380488.434788:0:17930:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787380488.434792:0:17930:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9d6ff3daa800 from 1 10000000:01000000:2.0:1787380488.434794:0:17930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787380488.434896:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e600/0xcf3c46fdcad69f10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380488.434903:0:17930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e600/0xcf3c46fdcad69f10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380488.434910:0:17930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e600/0xcf3c46fdcad69f10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380488.434923:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867518080:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787380488.434948:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380488.434960:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc52c0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380488.436084:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867518080 00000100:00100000:3.0:1787380488.436094:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867518080 00000100:00100000:3.0:1787380488.436137:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787380488.436146:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+13:17930:x1874203867518080:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787380488.436157:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380488.436180:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89d000/0xcf3c46fdcad69f17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad69f10 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380488.436199:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89d000/0xcf3c46fdcad69f17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad69f10 expref: 14 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380488.436209:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89d000/0xcf3c46fdcad69f17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69f10 expref: 14 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380488.436216:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89d000, rc 0) 00000100:00100000:3.0:1787380488.436278:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+14:17930:x1874203867518080:12345-0@lo:101:mount.lustre.0 Request processed in 134us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380488.436285:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787380488.436448:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867518080:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787380488.436462:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e600/0xcf3c46fdcad69f10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69f17 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380488.436471:0:17930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e600/0xcf3c46fdcad69f10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad69f17 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380488.436491:0:17930:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787380488.436496:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e600/0xcf3c46fdcad69f10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69f17 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380488.436504:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e600/0xcf3c46fdcad69f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69f17 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380488.436511:0:17930:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787380488.436515:0:17930:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787380488.436521:0:17930:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9d6ff3daa800 10000000:01000000:2.0:1787380488.436523:0:17930:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787380488.436526:0:17930:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787380488.436528:0:17930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787380488.436549:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fa00/0xcf3c46fdcad69f1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380488.436555:0:17930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fa00/0xcf3c46fdcad69f1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380488.436563:0:17930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fa00/0xcf3c46fdcad69f1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380488.436581:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867518208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787380488.436613:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380488.437077:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc52c0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380488.437148:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867518208 00000100:00100000:1.0:1787380488.437154:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867518208 00000100:00100000:0.0:1787380488.437558:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787380488.437569:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+14:17930:x1874203867518208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787380488.437580:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380488.437593:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7867600/0xcf3c46fdcad69f25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad69f1e expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.437613:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7867600/0xcf3c46fdcad69f25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad69f1e expref: 15 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.437699:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7867600/0xcf3c46fdcad69f25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69f1e expref: 15 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.437708:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867600, rc 0) 00000100:00100000:0.0:1787380488.437834:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+15:17930:x1874203867518208:12345-0@lo:101:mount.lustre.0 Request processed in 238us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380488.437906:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787380488.438429:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867518208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787380488.438445:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fa00/0xcf3c46fdcad69f1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69f25 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380488.438462:0:17930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fa00/0xcf3c46fdcad69f1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad69f25 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787380488.440545:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1787380488.449440:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787380488.464307:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787380488.464578:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1787380488.464597:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1787380488.464610:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1787380488.464783:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1787380488.464798:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1787380488.465159:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1787380488.465180:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1787380488.465193:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1787380488.465205:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1787380488.465218:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1787380488.465242:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1787380488.465257:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1787380488.465272:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1787380488.465287:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1787380488.465301:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1787380488.465314:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1787380488.465326:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1787380488.465533:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1787380488.465567:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1787380488.466126:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1787380488.466151:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1787380488.466167:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1787380488.466197:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1787380488.466202:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1787380488.466317:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867518336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787380488.466387:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380488.466421:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4e25780 going to sleep for 11 seconds 00000100:00100000:0.0:1787380488.466741:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867518336 00000100:00100000:0.0:1787380488.466748:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867518336 00000100:00100000:0.0:1787380488.466798:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787380488.466839:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+15:17930:x1874203867518336:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380488.466988:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+15:17930:x1874203867518336:12345-0@lo:501:mount.lustre.0 Request processed in 143us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380488.466995:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787380488.467632:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867518336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787380488.467671:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867518464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787380488.467721:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380488.467753:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4e25780 going to sleep for 11 seconds 00000100:00100000:0.0:1787380488.468006:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867518464 00000100:00100000:0.0:1787380488.468011:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867518464 00000100:00100000:0.0:1787380488.468048:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787380488.468056:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+15:17930:x1874203867518464:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787380488.469085:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+15:17930:x1874203867518464:12345-0@lo:503:mount.lustre.0 Request processed in 1025us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380488.469095:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787380488.474075:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867518464:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787380488.475046:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787380488.475127:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867518592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787380488.475203:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380488.475260:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4e25780 going to sleep for 11 seconds 00000100:00100000:2.0:1787380488.475437:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867518592 00000100:00100000:2.0:1787380488.475444:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867518592 00000100:00100000:2.0:1787380488.475493:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787380488.475501:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+15:17930:x1874203867518592:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380488.476925:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+15:17930:x1874203867518592:12345-0@lo:502:mount.lustre.0 Request processed in 1420us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380488.476937:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787380488.477101:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e31c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867518592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787380488.477381:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787380488.477412:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1787380488.477426:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1787380488.477440:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1787380488.477454:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1787380488.477467:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1787380488.477479:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1787380488.477491:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1787380488.477503:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1787380488.477515:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1787380488.477528:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1787380488.477551:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1787380488.477563:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1787380488.477574:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1787380488.477599:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1787380488.477626:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1787380488.477642:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1787380488.477654:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1787380488.477665:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1787380488.477679:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1787380488.477692:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1787380488.477703:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1787380488.477715:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1787380488.477729:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1787380488.477742:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1787380488.477754:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1787380488.477766:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1787380488.477779:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1787380488.477790:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1787380488.477802:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1787380488.477862:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1787380488.477878:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1787380488.477891:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1787380488.477903:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1787380488.477916:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1787380488.477927:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1787380488.477938:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1787380488.477949:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1787380488.477960:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1787380488.477971:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1787380488.478388:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1787380488.478413:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1787380488.478427:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1787380488.478441:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1787380488.478488:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867518720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787380488.478543:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380488.478575:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec249f540 going to sleep for 11 seconds 00000100:00100000:2.0:1787380488.478733:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867518720 00000100:00100000:2.0:1787380488.478740:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867518720 00000100:00100000:2.0:1787380488.478781:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787380488.478789:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+15:17930:x1874203867518720:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380488.478916:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+15:17930:x1874203867518720:12345-0@lo:502:mount.lustre.0 Request processed in 127us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380488.478922:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787380488.479109:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867518720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787380488.479156:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1787380488.479164:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1787380488.483526:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787380488.483539:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380488.483541:0:17934:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787380488.483547:0:17934:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1787380488.483550:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787380488.483564:0:17934:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9d6ffc73b380) 00000020:00000080:2.0:1787380488.483596:0:17934:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1787380488.483602:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787380488.483696:0:17934:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787380488.483703:0:17934:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf3c46fdcad69f33 00000020:00000080:2.0:1787380488.483940:0:17934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1787380488.483949:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380488.483952:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380488.483954:0:17934:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787380488.483956:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787380488.483959:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380488.483960:0:17934:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1787380488.483964:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787380488.483971:0:17934:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9d6ffc7399c0) 00000020:00000080:2.0:1787380488.484356:0:17934:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1787380488.484365:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787380488.484368:0:17934:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1787380488.484370:0:17934:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1787380488.484375:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787380488.484424:0:17934:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6ff3daa800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1787380488.484435:0:17934:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9d6ffc738000) 00000020:00000080:2.0:1787380488.484443:0:17934:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1787380488.484510:0:17934:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787380488.484516:0:17934:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3c46fdcad69f48 00000020:00000080:2.0:1787380488.485849:0:17934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1787380488.485860:0:17934:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787380488.485868:0:17934:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xcf3c46fdcad69f4f 00080000:01000000:2.0:1787380488.485876:0:17934:0:(osd_handler.c:8929:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787380488.485880:0:17934:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf3c46fdcad69f56 00000100:00100000:3.0:1787380488.524695:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00010000:00010000:3.0:1787380488.599135:0:17934:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1787380488.599559:0:17934:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1787380488.600831:0:17934:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787380488.603127:0:17934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1787380488.603140:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787380488.603146:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380488.603148:0:17934:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1787380488.603152:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787380488.603158:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787380488.603160:0:17934:0:(obd_config.c:1561:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1787380488.603162:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787380488.603167:0:17934:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.130@tcp to nid 0x20000c0a8ce82 (192.168.206.130@tcp) 00000020:00000080:1.0:1787380488.603192:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787380488.603207:0:17934:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9d6ec34f4d40) 00000020:00000080:1.0:1787380488.603237:0:17934:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1787380488.603243:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787380488.603312:0:17934:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1787380488.603318:0:17934:0:(osd_handler.c:8929:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787380488.603324:0:17934:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf3c46fdcad69f64 00010000:00080000:1.0:1787380488.603368:0:17934:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6fd1710000@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.130@tcp at head 00010000:00010000:1.0:1787380488.610511:0:17934:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1787380488.617837:0:17934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787380488.617852:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787380488.617902:0:17934:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787380488.617922:0:17934:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3c46fdcad69f6b 00000100:00080000:3.0:1787380488.617931:0:17934:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787380488.617943:0:17934:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9d6fd1710000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1787380488.618170:0:17934:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff4e33800 x1874203867518848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787380488.618191:0:17934:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1787380488.618295:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380488.618299:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380488.618301:0:17934:0:(obd_config.c:1561:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1787380488.618304:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787380488.618307:0:17934:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1787380488.618308:0:17934:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787380488.618310:0:17934:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787380488.618311:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787380488.618313:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380488.618315:0:17934:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787380488.618317:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380488.618340:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380488.618342:0:17934:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1787380488.618346:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787380488.618377:0:17934:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787380488.618390:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380488.618393:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380488.618394:0:17934:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1787380488.618396:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787380488.618398:0:17934:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1787380488.618399:0:17934:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787380488.618401:0:17934:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787380488.618403:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787380488.618405:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380488.618406:0:17934:0:(obd_config.c:1561:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787380488.618409:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787380488.618412:0:17934:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787380488.618415:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380488.618423:0:17934:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787380488.618428:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787380488.618440:0:17934:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.130@tcp to nid 0x20000c0a8ce82 (192.168.206.130@tcp) 00000020:01000000:3.0:1787380488.618462:0:17934:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787380488.618474:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787380488.618486:0:17934:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9d6ff4f74d40) 00000020:00000080:3.0:1787380488.618499:0:17934:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1787380488.618505:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787380488.618556:0:17934:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1787380488.618562:0:17934:0:(osd_handler.c:8929:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787380488.618567:0:17934:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf3c46fdcad69f79 00010000:00080000:3.0:1787380488.618604:0:17934:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ffb910000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.130@tcp at head 00010000:00010000:3.0:1787380488.618829:0:17934:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1787380488.618956:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867518848:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787380488.619027:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380488.619089:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867518848 00000100:00100000:2.0:1787380488.619095:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867518848 00000100:00100000:2.0:1787380488.619130:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787380488.619137:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1874203867518848:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787380488.619167:0:17204:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:2.0:1787380488.619193:0:17204:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3c46fdcad69f80 00000004:00100000:2.0:1787380488.619206:0:17204:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787380488.619210:0:17204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:3.0:1787380488.620290:0:17934:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787380488.621166:0:17934:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1787380488.622261:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787380488.622268:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787380488.622272:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3d45000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787380488.622280:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:0.0:1787380488.622285:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787380488.622291:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d6ec3d45000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1787380488.622388:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6fc43ead80 x1874203867518976/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787380488.622410:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380488.622414:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787380488.622417:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380488.622420:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787380488.622602:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867519104:0@lo:400:kworker.0 00000100:00100000:0.0:1787380488.623212:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380488.623287:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867519104 00000100:00100000:0.0:1787380488.623295:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867519104 00000100:00100000:0.0:1787380488.623637:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787380488.623647:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867519104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380488.623799:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867519104:12345-0@lo:400:kworker.0 Request processed in 154us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380488.623825:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787380488.623929:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867518976:0@lo:38:kworker.0 00000100:00100000:2.0:1787380488.623966:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380488.624075:0:17205:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1787380488.624083:0:17205:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:3.0:1787380488.625788:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d6fc43eb800 x1874203867519104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380488.625804:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867519104:0@lo:400:kworker.0 00000100:00100000:0.0:1787380488.627643:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867518976 00000100:00100000:0.0:1787380488.627655:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867518976 00000100:00100000:3.0:1787380488.628438:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787380488.628447:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1874203867518976:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787380488.628541:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1874203867518976:12345-0@lo:38:kworker.0 Request processed in 94us (4573us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787380488.628549:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787380488.629118:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787380488.629127:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3d45000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787380488.629132:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787380488.629135:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867518976:0@lo:38:kworker.0 00000040:00080000:3.0:1787380488.634033:0:17934:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787380488.634382:0:17934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787380488.634521:0:17934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00080000:2.0:1787380488.634537:0:17204:0:(import.c:65:import_set_state_nolock()) ffff9d6fd2f4b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787380488.634631:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1874203867518848:12345-0@lo:38:llog_process_th.0 Request processed in 15491us (15600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380488.634641:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380488.634778:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787380488.634787:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787380488.634796:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787380488.634829:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787380488.634833:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6fd1710000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787380488.634852:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867518848:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787380488.635002:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867519232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380488.635038:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380488.635164:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867519232 00000100:00100000:2.0:1787380488.635170:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867519232 00000100:00100000:2.0:1787380488.635211:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787380488.635219:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1874203867519232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787380488.635252:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787380488.635296:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1874203867519232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380488.635302:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787380488.635333:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867519232:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1787380488.636101:0:17940:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787380488.636107:0:17940:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787380488.637241:0:17934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787380488.637255:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787380488.637301:0:17934:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787380488.637322:0:17934:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3c46fdcad69f87 00000100:00080000:2.0:1787380488.637332:0:17934:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787380488.637337:0:17934:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9d6ffb910000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:2.0:1787380488.637370:0:17934:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3cb1c00 x1874203867519360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787380488.637423:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867519360:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787380488.637479:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874203867519360 offset 0 length 520: 4 00000100:00080000:2.0:1787380488.637528:0:17934:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787380488.637641:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380488.637645:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380488.637647:0:17934:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787380488.637650:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787380488.637652:0:17934:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1787380488.637654:0:17934:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787380488.637655:0:17934:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787380488.637657:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787380488.637659:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380488.637660:0:17934:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787380488.637662:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787380488.637666:0:17934:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787380488.637669:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380488.637670:0:17934:0:(obd_config.c:1561:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787380488.637673:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787380488.637677:0:17934:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.206.130@tcp to nid 0x20000c0a8ce82 (192.168.206.130@tcp) 00000020:01000000:2.0:1787380488.637697:0:17934:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787380488.637700:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787380488.637719:0:17934:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9d6ffc2919c0) 00000020:00000080:2.0:1787380488.637732:0:17934:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1787380488.637739:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787380488.637795:0:17934:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1787380488.637802:0:17934:0:(osd_handler.c:8929:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787380488.637831:0:17934:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcf3c46fdcad69f95 00010000:00080000:2.0:1787380488.637859:0:17934:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6feb639800@lustre-OST0001-osc-MDT0001: add connection 192.168.206.130@tcp at head 00010000:00010000:2.0:1787380488.638077:0:17934:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1787380488.638142:0:17934:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787380488.638157:0:17934:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1787380488.638363:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380488.638368:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787380488.638370:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380488.638373:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787380488.640164:0:17934:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787380488.640445:0:17934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787380488.640566:0:17934:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787380488.641522:0:17942:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787380488.641528:0:17942:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787380488.645242:0:17934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787380488.645258:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787380488.645305:0:17934:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787380488.645325:0:17934:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3c46fdcad69f9c 00000100:00080000:3.0:1787380488.645335:0:17934:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787380488.645341:0:17934:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d6feb639800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1787380488.645375:0:17934:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff4e31c00 x1874203867519488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787380488.645403:0:17934:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1787380488.645483:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867519488:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787380488.645549:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874203867519488 offset 0 length 520: 4 00000020:01000000:3.0:1787380488.645673:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380488.645677:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380488.645679:0:17934:0:(obd_config.c:1561:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787380488.645682:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380488.645686:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380488.645687:0:17934:0:(obd_config.c:1561:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787380488.645689:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787380488.645691:0:17934:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787380488.645693:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380488.645702:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380488.645704:0:17934:0:(obd_config.c:1561:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787380488.645707:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380488.645710:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380488.645711:0:17934:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787380488.645714:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787380488.645746:0:17934:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380488.645750:0:17934:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380488.645751:0:17934:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787380488.645755:0:17934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:1.0:1787380488.646185:0:17930:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1787380488.646213:0:17930:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787380488.646238:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fa00/0xcf3c46fdcad69f1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69f25 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.646249:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fa00/0xcf3c46fdcad69f1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69f25 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380488.646265:0:17930:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6ff3daa800 from 1 10000000:01000000:1.0:1787380488.646268:0:17930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787380488.646295:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1600/0xcf3c46fdcad69fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.646303:0:17930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1600/0xcf3c46fdcad69fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.646313:0:17930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1600/0xcf3c46fdcad69fa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380488.646330:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867519616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787380488.646370:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380488.646407:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e510c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380488.646627:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867519616 00000100:00100000:3.0:1787380488.646635:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867519616 00000100:00100000:3.0:1787380488.646677:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787380488.646686:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+15:17930:x1874203867519616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787380488.646698:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380488.646710:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89c200/0xcf3c46fdcad69faa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad69fa3 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380488.646732:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89c200/0xcf3c46fdcad69faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad69fa3 expref: 16 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380488.646742:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89c200/0xcf3c46fdcad69faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69fa3 expref: 16 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380488.646750:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89c200, rc 0) 00000100:00100000:3.0:1787380488.646793:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+16:17930:x1874203867519616:12345-0@lo:101:mount.lustre.0 Request processed in 108us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380488.646800:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787380488.647036:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867519616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380488.647049:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1600/0xcf3c46fdcad69fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69faa expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.647057:0:17930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1600/0xcf3c46fdcad69fa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad69faa expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380488.647602:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867519744:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787380488.647716:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380488.647753:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e510c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380488.648358:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867519744 00000100:00100000:3.0:1787380488.648366:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867519744 00000100:00100000:3.0:1787380488.648454:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787380488.648471:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+16:17930:x1874203867519744:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787380488.648490:0:17194:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787380488.648505:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787380488.648508:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787380488.648605:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+16:17930:x1874203867519744:12345-0@lo:256:mount.lustre.0 Request processed in 135us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380488.648612:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787380488.648689:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380488.648694:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787380488.648696:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380488.648699:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787380488.648837:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867519744:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787380488.649406:0:17930:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787380488.649425:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1600/0xcf3c46fdcad69fa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69faa expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.649435:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1600/0xcf3c46fdcad69fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69faa expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380488.649443:0:17930:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ff3daa800 from 1 10000000:01000000:1.0:1787380488.649445:0:17930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787380488.649470:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0e00/0xcf3c46fdcad69fb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.649477:0:17930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0e00/0xcf3c46fdcad69fb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.649486:0:17930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0e00/0xcf3c46fdcad69fb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380488.649502:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867519872:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787380488.649537:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380488.649729:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e510c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380488.649877:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867519872 00000100:00100000:2.0:1787380488.649883:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867519872 00000100:00100000:2.0:1787380488.649913:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787380488.649920:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+16:17930:x1874203867519872:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787380488.649929:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380488.649942:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69fb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad69fb1 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380488.649964:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69fb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad69fb1 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380488.649973:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69fb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69fb1 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380488.649981:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0ee00, rc 0) 00000100:00100000:2.0:1787380488.650018:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17930:x1874203867519872:12345-0@lo:101:mount.lustre.0 Request processed in 98us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380488.650024:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787380488.650115:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867519872:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380488.650127:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0e00/0xcf3c46fdcad69fb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69fb8 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.650135:0:17930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0e00/0xcf3c46fdcad69fb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad69fb8 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787380488.650263:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787380488.650293:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867520000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380488.650332:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380488.650359:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e51900 going to sleep for 11 seconds 00000100:00100000:2.0:1787380488.650407:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867520000 00000100:00100000:2.0:1787380488.650412:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867520000 00000100:00100000:2.0:1787380488.650429:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787380488.650442:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17930:x1874203867520000:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380488.650569:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17930:x1874203867520000:12345-0@lo:501:mount.lustre.0 Request processed in 127us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380488.650577:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787380488.650794:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867520000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380488.650897:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867520128:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787380488.650936:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380488.651002:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e51900 going to sleep for 11 seconds 00000100:00100000:0.0:1787380488.651079:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867520128 00000100:00100000:0.0:1787380488.651084:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867520128 00000100:00100000:2.0:1787380488.651129:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787380488.651137:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17930:x1874203867520128:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787380488.651220:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17930:x1874203867520128:12345-0@lo:503:mount.lustre.0 Request processed in 84us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380488.651238:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787380488.651312:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867520128:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787380488.651729:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787380488.651794:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867520256:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787380488.651870:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380488.651892:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e51900 going to sleep for 11 seconds 00000100:00100000:3.0:1787380488.652387:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867520256 00000100:00100000:3.0:1787380488.652393:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867520256 00000100:00100000:3.0:1787380488.652428:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787380488.652436:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17930:x1874203867520256:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787380488.652529:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17930:x1874203867520256:12345-0@lo:502:mount.lustre.0 Request processed in 94us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380488.652536:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787380488.652711:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867520256:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787380488.652988:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787380488.653015:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:1.0:1787380488.653029:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:1.0:1787380488.653043:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:1.0:1787380488.653056:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:1.0:1787380488.653068:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:1.0:1787380488.653080:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:1.0:1787380488.653093:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:1.0:1787380488.653107:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787380488.653119:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:1.0:1787380488.653133:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:1.0:1787380488.653159:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867520384:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787380488.653199:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380488.653235:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e51900 going to sleep for 11 seconds 00000100:00100000:3.0:1787380488.654878:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867520384 00000100:00100000:3.0:1787380488.654888:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867520384 00000100:00100000:3.0:1787380488.654927:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787380488.654934:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17930:x1874203867520384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787380488.655056:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17930:x1874203867520384:12345-0@lo:502:mount.lustre.0 Request processed in 122us (1856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380488.655064:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787380488.655319:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867520384:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787380488.655392:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:1.0:1787380488.655404:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787380488.656897:0:17944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380488.656907:0:17944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380488.656909:0:17944:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787380488.656916:0:17944:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6ff3daa800 00000020:00000080:3.0:1787380488.656919:0:17944:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787380488.656925:0:17944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380488.656928:0:17944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380488.656937:0:17944:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787380488.656942:0:17944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380488.656944:0:17944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380488.656946:0:17944:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787380488.656949:0:17944:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6ff3daa800 00000020:00000080:3.0:1787380488.656951:0:17944:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787380488.657012:0:17944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380488.657016:0:17944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380488.657017:0:17944:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787380488.657019:0:17944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380488.657021:0:17944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380488.657022:0:17944:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787380488.658912:0:17944:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6ff3daa800 00000020:00000080:3.0:1787380488.658916:0:17944:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787380488.658961:0:17944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380488.658965:0:17944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380488.658967:0:17944:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787380488.658970:0:17944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380488.658987:0:17944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380488.658989:0:17944:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787380488.658993:0:17944:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6ff3daa800 00000020:00000080:3.0:1787380488.658996:0:17944:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787380488.659030:0:17944:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380488.659033:0:17944:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380488.659035:0:17944:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787380488.659038:0:17944:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:2.0:1787380488.659198:0:17930:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787380488.659242:0:17930:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787380488.659260:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0e00/0xcf3c46fdcad69fb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69fb8 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380488.659272:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0e00/0xcf3c46fdcad69fb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69fb8 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380488.659328:0:17930:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787380488.659331:0:17930:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d6ff3daa800 10000000:01000000:2.0:1787380488.659334:0:17930:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d6ff3daa800 10000000:01000000:2.0:1787380488.659338:0:17930:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787380488.659343:0:17930:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6ff3daa800 from 1 10000000:01000000:2.0:1787380488.659345:0:17930:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787380488.659380:0:17930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e000/0xcf3c46fdcad69fbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380488.659388:0:17930:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e000/0xcf3c46fdcad69fbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380488.659408:0:17930:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e000/0xcf3c46fdcad69fbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380488.659428:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867520512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787380488.659484:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380488.659527:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb62f900 going to sleep for 11 seconds 00000100:00100000:3.0:1787380488.663758:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867520512 00000100:00100000:3.0:1787380488.663773:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867520512 00000100:00100000:3.0:1787380488.663840:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787380488.663849:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17930:x1874203867520512:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787380488.663863:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380488.663880:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89c000/0xcf3c46fdcad69fc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad69fbf expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380488.663912:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89c000/0xcf3c46fdcad69fc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad69fbf expref: 18 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380488.663921:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89c000/0xcf3c46fdcad69fc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69fbf expref: 18 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380488.663929:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89c000, rc 0) 00000100:00100000:3.0:1787380488.663995:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17930:x1874203867520512:12345-0@lo:101:mount.lustre.0 Request processed in 148us (4511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380488.664002:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787380488.664054:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867520512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787380488.664069:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e000/0xcf3c46fdcad69fbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69fc6 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380488.664078:0:17930:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e000/0xcf3c46fdcad69fbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad69fc6 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787380488.667386:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787380488.667723:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787380488.667938:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1787380488.667965:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1787380488.668786:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1787380488.668831:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1787380488.668849:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1787380488.668875:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1787380488.668889:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1787380488.668900:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1787380488.668912:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1787380488.668924:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1787380488.668935:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1787380488.668946:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1787380488.668957:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1787380488.668969:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1787380488.668994:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1787380488.669010:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1787380488.669021:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1787380488.669034:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1787380488.669046:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1787380488.669059:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1787380488.669073:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1787380488.669101:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1787380488.669125:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1787380488.669140:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1787380488.669152:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1787380488.669164:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1787380488.669176:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1787380488.669189:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1787380488.669210:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1787380488.669216:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787380488.669320:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867520640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380488.669382:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380488.669426:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867520640 00000100:00100000:2.0:1787380488.669432:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867520640 00000100:00100000:2.0:1787380488.669473:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787380488.669481:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17930:x1874203867520640:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380488.669586:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17930:x1874203867520640:12345-0@lo:501:mount.lustre.0 Request processed in 104us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380488.669594:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787380488.669858:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb62f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380488.669879:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867520640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380488.669912:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867520768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787380488.669951:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380488.669985:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867520768 00000100:00100000:2.0:1787380488.669990:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867520768 00000100:00100000:2.0:1787380488.670013:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787380488.670019:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17930:x1874203867520768:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787380488.671083:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17930:x1874203867520768:12345-0@lo:503:mount.lustre.0 Request processed in 1059us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380488.671101:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787380488.671155:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb62f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380488.671174:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867520768:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787380488.671560:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787380488.671858:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867520896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380488.671904:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380488.671938:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867520896 00000100:00100000:2.0:1787380488.671944:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867520896 00000100:00100000:2.0:1787380488.673150:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787380488.673165:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17930:x1874203867520896:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380488.673302:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17930:x1874203867520896:12345-0@lo:502:mount.lustre.0 Request processed in 141us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380488.673310:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787380488.673367:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb62f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380488.673388:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867520896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787380488.673722:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1787380488.673748:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1787380488.673761:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1787380488.673773:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1787380488.673785:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1787380488.673843:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1787380488.673860:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1787380488.673872:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1787380488.673883:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1787380488.673894:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1787380488.673904:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1787380488.673914:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1787380488.673933:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1787380488.673945:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1787380488.673957:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1787380488.673970:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1787380488.673995:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1787380488.674011:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1787380488.674024:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1787380488.674036:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1787380488.674048:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1787380488.674071:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1787380488.674085:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1787380488.674097:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1787380488.674109:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1787380488.674120:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1787380488.674129:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1787380488.674139:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1787380488.674151:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1787380488.674162:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1787380488.674174:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1787380488.674184:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1787380488.674195:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1787380488.674207:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1787380488.674218:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1787380488.674243:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1787380488.674256:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1787380488.674282:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1787380488.674297:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1787380488.674310:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1787380488.674321:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1787380488.674335:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1787380488.674347:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1787380488.674359:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1787380488.674371:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1787380488.674395:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1787380488.674408:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1787380488.674420:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1787380488.674460:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867521024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380488.674513:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380488.674549:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867521024 00000100:00100000:2.0:1787380488.674555:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867521024 00000100:00100000:2.0:1787380488.674590:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787380488.674597:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17930:x1874203867521024:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380488.674691:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17930:x1874203867521024:12345-0@lo:502:mount.lustre.0 Request processed in 94us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380488.674698:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787380488.674737:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb62f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380488.674753:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867521024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787380488.674895:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1787380488.674916:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1787380488.674936:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867521152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380488.674966:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380488.674986:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867521152 00000100:00100000:2.0:1787380488.674990:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867521152 00000100:00100000:2.0:1787380488.675010:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787380488.675016:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17930:x1874203867521152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380488.675080:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17930:x1874203867521152:12345-0@lo:502:mount.lustre.0 Request processed in 63us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380488.675086:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787380488.675121:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb62f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380488.675133:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867521152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787380488.675170:0:17930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1787380488.675177:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787380488.684559:0:17948:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1787380488.684575:0:17948:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9d6ec34f19c0) 00000020:00000080:1.0:1787380488.684608:0:17948:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1787380488.684973:0:17948:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6ff3daa800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787380488.685086:0:17948:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6ff3daa800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787380488.685089:0:17948:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6ff3daa800 3 00010000:00080000:1.0:1787380488.685119:0:17948:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6fc2bdf000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.130@tcp at head 00010000:00010000:0.0:1787380488.707324:0:17948:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1787380488.707495:0:17948:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1787380488.707562:0:17948:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787380488.707573:0:17948:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xcf3c46fdcad69fd4 00000100:00080000:0.0:1787380488.707582:0:17948:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787380488.707587:0:17948:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9d6fc2bdf000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1787380488.707684:0:17948:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6fc43eaa00 x1874203867521280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787380488.712031:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874203867521280:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787380488.712110:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380488.712181:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867521280 00000100:00100000:3.0:1787380488.712188:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867521280 00000100:00100000:3.0:1787380488.712222:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787380488.712246:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1874203867521280:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787380488.712273:0:17201:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 499 last 0 00000020:00000080:3.0:1787380488.712308:0:17201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcf3c46fdcad69fdb 00000004:00100000:3.0:1787380488.712322:0:17201:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787380488.712363:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9d6feb63f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787380488.712412:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1874203867521280:12345-0@lo:38:llog_process_th.0 Request processed in 165us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380488.712420:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787380488.712463:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d6fc43eaa00 x1874203867521280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787380498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380488.712473:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787380488.712480:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1787380488.712487:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787380488.712491:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787380488.712494:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6fc2bdf000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787380488.712499:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3638:1874203867521280:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787380488.713897:0:17948:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787380488.713968:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787380488.713982:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787380488.713986:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3d45000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787380488.713995:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d6ec3d45000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1787380488.714014:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6fc43e9500 x1874203867521536/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787380488.714027:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380488.714030:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787380488.714033:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380488.714035:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787380488.714075:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380488.714079:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787380488.714081:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380488.714083:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787380488.715410:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867521408:0@lo:400:kworker.0 00000100:00100000:0.0:1787380488.715410:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867521792:0@lo:400:kworker.0 00000100:00100000:0.0:1787380488.719747:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380488.720183:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867521792 00000100:00100000:2.0:1787380488.720191:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867521792 00000100:00100000:3.0:1787380488.720328:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380488.720367:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380488.720378:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867521664:0@lo:400:kworker.0 00000100:00100000:3.0:1787380488.720416:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1787380488.720510:0:17948:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000100:00100000:3.0:1787380488.720599:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867521536:0@lo:38:kworker.0 00000100:00100000:3.0:1787380488.720635:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380488.720709:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867521664 00000100:00100000:1.0:1787380488.720715:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867521664 00000100:00100000:1.0:1787380488.720752:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787380488.720760:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867521664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380488.720836:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867521664:12345-0@lo:400:kworker.0 Request processed in 76us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380488.720844:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787380488.720987:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d6fc43e9c00 x1874203867521664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380488.721000:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867521664:0@lo:400:kworker.0 00000100:00100000:2.0:1787380488.721036:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787380488.721049:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1874203867521792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380488.722968:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3639:x1874203867521792:12345-0@lo:400:kworker.0 Request processed in 1916us (3222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380488.723454:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867521536 00000100:00100000:0.0:1787380488.723462:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867521536 00000100:00100000:0.0:1787380488.723490:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787380488.723497:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1874203867521536:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787380488.723563:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3638:x1874203867521536:12345-0@lo:38:kworker.0 Request processed in 64us (2927us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787380488.723570:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787380488.723678:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787380488.723711:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867521408 00000100:00100000:2.0:1787380488.723715:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867521408 00000100:00100000:2.0:1787380488.723742:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787380488.723749:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:3641:x1874203867521408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380488.723796:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:3641:x1874203867521408:12345-0@lo:400:kworker.0 Request processed in 47us (3471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380488.723828:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1787380488.724267:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3d45000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787380488.724273:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787380488.724285:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867521536:0@lo:38:kworker.0 00000100:00100000:0.0:1787380488.724448:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867521408:0@lo:400:kworker.0 00000020:01000000:2.0:1787380488.724525:0:17930:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787380488.724561:0:17930:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787380488.724611:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e000/0xcf3c46fdcad69fbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69fc6 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380488.724632:0:17930:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e000/0xcf3c46fdcad69fbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69fc6 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787380488.724685:0:17930:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787380488.724687:0:17930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787380488.724688:0:17930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380488.724690:0:17930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380488.724694:0:17930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380488.724696:0:17930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380488.724697:0:17930:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787380488.724699:0:17930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380488.724700:0:17930:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787380488.724704:0:17930:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1787380488.724706:0:17930:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787380488.724707:0:17930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787380488.724708:0:17930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380488.724709:0:17930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380488.724710:0:17930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380488.724711:0:17930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380488.724711:0:17930:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787380488.724712:0:17930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380488.724713:0:17930:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787380488.724732:0:17930:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787380488.724746:0:17930:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867521920:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787380488.724789:0:17930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380488.724882:0:17930:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb62fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380488.724909:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867521792:0@lo:400:kworker.0 00000100:00100000:2.0:1787380488.724927:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867521920 00000100:00100000:2.0:1787380488.724931:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867521920 00000100:00100000:2.0:1787380488.724957:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787380488.724964:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17930:x1874203867521920:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787380488.724998:0:17192:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787380488.725010:0:17192:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1787380488.733861:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1787380488.734909:0:17192:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787380488.734967:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787380488.737550:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17930:x1874203867521920:12345-0@lo:253:mount.lustre.0 Request processed in 12577us (12752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380488.737564:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787380488.737799:0:17930:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17930:1874203867521920:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787380488.737877:0:17930:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787380488.737882:0:17930:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787380488.737883:0:17930:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787380488.737885:0:17930:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380488.737895:0:17930:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380488.737896:0:17930:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380488.737897:0:17930:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380488.737899:0:17930:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787380488.737900:0:17930:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380488.737902:0:17930:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787380488.737917:0:17930:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1787380488.744789:0:17215:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787380488.744798:0:17215:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787380488.745900:0:17215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fe7867a00/0xcf3c46fdcad69fe2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.745922:0:17215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad69ee6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69edf expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.745931:0:17215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ffb89c200/0xcf3c46fdcad69faa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69fa3 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.745939:0:17215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6fe7867a00/0xcf3c46fdcad69fe2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.745991:0:17215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ffb89c200/0xcf3c46fdcad69faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad69fa3 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.746008:0:17215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6ffb89c200/0xcf3c46fdcad69faa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad69fa3 expref: 17 pid: 17193 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380488.746022:0:17215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1874203867522048:0@lo:104: 00000100:00100000:0.0:1787380488.746084:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787380488.746129:0:17215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad69ee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad69edf expref: 17 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.746137:0:17215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad69ee6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad69edf expref: 17 pid: 17194 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380488.746161:0:17215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1874203867522176:0@lo:104: 00000100:00100000:0.0:1787380488.746184:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380488.746201:0:17215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380488.746253:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867522048 00000100:00100000:0.0:1787380488.746260:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867522048 00000100:00100000:0.0:1787380488.746289:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867522176 00000100:00100000:0.0:1787380488.746292:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867522176 00000100:00100000:0.0:1787380488.746307:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787380488.746314:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+4:17215:x1874203867522048:12345-0@lo:104: 00010000:00010000:0.0:1787380488.746326:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1600/0xcf3c46fdcad69fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad69faa expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.746372:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787380488.746379:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+4:17215:x1874203867522048:12345-0@lo:104: Request processed in 64us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380488.746385:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787380488.746400:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787380488.746406:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+3:17215:x1874203867522176:12345-0@lo:104: 00010000:00010000:0.0:1787380488.746413:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad69edf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad69ee6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.746442:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787380488.746448:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+3:17215:x1874203867522176:12345-0@lo:104: Request processed in 42us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380488.746453:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787380488.746471:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787380488.746476:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1600/0xcf3c46fdcad69fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad69faa expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.746489:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1600 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:0.0:1787380488.746493:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1600/0xcf3c46fdcad69fa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad69faa expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.746500:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1600/0xcf3c46fdcad69fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad69faa expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380488.746507:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1600/0xcf3c46fdcad69fa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad69faa expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380488.746513:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787380488.746540:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1600/0xcf3c46fdcad69fa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69faa expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.746546:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380488.746571:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1600/0xcf3c46fdcad69fa3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69faa expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.746578:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1600/0xcf3c46fdcad69fa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69faa expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.746591:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380488.746594:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad69edf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad69ee6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.746600:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867200 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:0.0:1787380488.746603:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad69edf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad69ee6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.747373:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad69edf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad69ee6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380488.747381:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad69edf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad69ee6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380488.747386:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787380488.747407:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad69edf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69ee6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.747413:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380488.747434:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad69edf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69ee6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.747440:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fe7867200/0xcf3c46fdcad69edf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69ee6 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.747457:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380488.747458:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380488.747460:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380488.747468:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380488.747479:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867522432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380488.747516:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380488.747565:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867522432 00000100:00100000:0.0:1787380488.747571:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867522432 00010000:00010000:0.0:1787380488.747590:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad69ee6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad69edf expref: 18 pid: 17194 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380488.749961:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787380488.750003:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:3641:x1874203867522432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787380488.750021:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380488.750030:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad69ee6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad69edf expref: 18 pid: 17194 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.750043:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad69ee6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad69edf expref: 18 pid: 17194 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380488.750063:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380488.750123:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:3641:x1874203867522432:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (2607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380488.750131:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787380488.750183:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867522432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380488.750212:0:17215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1874203867522048:0@lo:104: 00010000:00010000:0.0:1787380488.750222:0:17215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffb89d800/0xcf3c46fdcad69ee6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad69edf expref: 17 pid: 17194 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380488.750246:0:17215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1874203867522176:0@lo:104: 00010000:00010000:0.0:1787380488.750260:0:17215:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6fe7867a00/0xcf3c46fdcad69fe2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380488.750853:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3640:1874203867522304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787380488.750895:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380488.752164:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867522304 00000100:00100000:1.0:1787380488.752175:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867522304 00010000:00010000:1.0:1787380488.752208:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ffb89c200/0xcf3c46fdcad69faa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad69fa3 expref: 17 pid: 17193 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380488.752252:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787380488.752260:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:3640:x1874203867522304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380488.752272:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380488.752276:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ffb89c200/0xcf3c46fdcad69faa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad69fa3 expref: 17 pid: 17193 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.752289:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ffb89c200/0xcf3c46fdcad69faa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad69fa3 expref: 17 pid: 17193 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.752316:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffb89c200/0xcf3c46fdcad69faa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad69fa3 expref: 17 pid: 17193 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.752332:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6fe7867a00/0xcf3c46fdcad69fe2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.752340:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7867a00/0xcf3c46fdcad69fe2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787380488.752355:0:17184:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008205876s 00010000:00010000:1.0:1787380488.752359:0:17184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fe7867a00/0xcf3c46fdcad69fe2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.752366:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fe7867a00/0xcf3c46fdcad69fe2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.752373:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fe7867a00/0xcf3c46fdcad69fe2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.752380:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fe7867a00/0xcf3c46fdcad69fe2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.752386:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867a00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380488.752390:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fe7867a00/0xcf3c46fdcad69fe2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.752398:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fe7867a00/0xcf3c46fdcad69fe2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.752413:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fe7867a00/0xcf3c46fdcad69fe2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.752429:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380488.752481:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+16:3640:x1874203867522304:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380488.752488:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787380488.752645:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3640:1874203867522304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380488.752690:0:17215:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6fe7867a00/0xcf3c46fdcad69fe2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.752698:0:17215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fe7867a00/0xcf3c46fdcad69fe2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380488.752704:0:17215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7867a00/0xcf3c46fdcad69fe2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1787380488.755265:0:17930:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1787380488.755484:0:17954:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1787380488.755488:0:17954:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787380488.756947:0:17955:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787380488.757056:0:17930:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1787380488.757867:0:17956:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17956:1874203867522560:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787380488.757927:0:17956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380488.757955:0:17956:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb833540 going to sleep for 11 seconds 00000040:01000000:3.0:1787380488.758299:0:17930:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1787380488.758337:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380488.758741:0:17955:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787380488.759246:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867522560 00000100:00100000:0.0:1787380488.759255:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867522560 00000100:00100000:0.0:1787380488.759298:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787380488.759306:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17956:x1874203867522560:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787380488.759388:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17956:x1874203867522560:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 82us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380488.759405:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00000080:3.0:1787380488.760239:0:17930:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787380488.760251:0:17930:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1787380488.760314:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787380488.762563:0:17956:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17956:1874203867522560:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1787380488.762605:0:17956:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1787380488.762660:0:17956:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17956:1874203867522688:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787380488.762720:0:17956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380488.762759:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867522688 00000100:00100000:2.0:1787380488.762765:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867522688 00000100:00100000:2.0:1787380488.762826:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787380488.762835:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17956:x1874203867522688:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787380488.762963:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17956:x1874203867522688:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 128us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380488.762971:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787380488.763005:0:17956:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb833540 going to sleep for 11 seconds 00000100:00100000:2.0:1787380488.763018:0:17956:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17956:1874203867522688:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787380488.763068:0:17956:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17956:1874203867522816:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787380488.763104:0:17956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380488.763135:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867522816 00000100:00100000:2.0:1787380488.763139:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867522816 00000100:00100000:2.0:1787380488.763162:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380488.763169:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17956:x1874203867522816:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787380488.763201:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17956:x1874203867522816:12345-0@lo:900:lod0001_rec0000.0 Request processed in 32us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380488.763207:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380488.763236:0:17956:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb833600 going to sleep for 11 seconds 00010000:00080000:2.0:1787380488.763251:0:17956:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9d6ec3cb3b80 x1874203867522816/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787380504 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380488.763260:0:17956:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17956:1874203867522816:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1787380488.763294:0:17956:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17956:1874203867522944:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787380488.763316:0:17956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380488.763334:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867522944 00000100:00100000:2.0:1787380488.763337:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867522944 00000100:00100000:2.0:1787380488.763357:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787380488.763363:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17956:x1874203867522944:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1787380488.763405:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17956:x1874203867522944:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 41us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380488.763411:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787380488.763427:0:17956:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb833540 going to sleep for 11 seconds 00000100:00100000:2.0:1787380488.763439:0:17956:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17956:1874203867522944:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1787380488.763475:0:17956:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380488.768029:0:17955:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787380488.768104:0:17955:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1787380488.768382:0:17930:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787380488.773508:0:17930:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787380488.773586:0:17930:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1787380488.773721:0:17930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787380488.777960:0:17930:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:2.0:1787380488.779666:0:17956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787380488.779734:0:17956:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787380488.779739:0:17956:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:3.0:1787380488.781109:0:17930:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787380488.804605:0:17930:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787380488.804653:0:17930:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb3a8015ff988 00100000:10000000:0.0:1787380488.804662:0:17930:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1787380488.806602:0:17930:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787380488.806894:0:17930:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787380488.806913:0:17930:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787380488.806933:0:17930:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1787380488.807921:0:17930:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787380488.808140:0:17930:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787380489.101218:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380489.547903:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00000040:00080000:0.0:1787380489.804524:0:17958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1787380490.000685:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787380490.000692:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6ff3daa800 from 8 10000000:01000000:1.0:1787380490.000697:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787380490.000743:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0200/0xcf3c46fdcad69fe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380490.000755:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0200/0xcf3c46fdcad69fe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380490.000791:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0200/0xcf3c46fdcad69fe9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380490.000843:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867523072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787380490.000909:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380490.000969:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e51000 going to sleep for 11 seconds 00000100:00100000:2.0:1787380490.001102:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867523072 00000100:00100000:2.0:1787380490.001109:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867523072 00000100:00100000:2.0:1787380490.001150:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787380490.001157:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+16:17196:x1874203867523072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380490.001169:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380490.001182:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ff0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad69fe9 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380490.001202:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad69fe9 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380490.001212:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69fe9 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380490.001231:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fd0d0ec00, rc 0) 00000100:00100000:2.0:1787380490.001275:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17196:x1874203867523072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380490.001281:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787380490.004004:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867523072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380490.004029:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0200/0xcf3c46fdcad69fe9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69ff0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380490.004042:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0200/0xcf3c46fdcad69fe9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad69ff0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380490.004108:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867523200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787380490.004169:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380490.004210:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e51000 going to sleep for 11 seconds 00000100:00100000:2.0:1787380490.010165:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867523200 00000100:00100000:2.0:1787380490.010180:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867523200 00000100:00100000:2.0:1787380490.010243:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787380490.010252:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17196:x1874203867523200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787380490.010272:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787380490.010287:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787380490.010290:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787380490.010392:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17196:x1874203867523200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (6222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380490.010417:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787380490.010464:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867523200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787380490.010526:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787380490.010535:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0200/0xcf3c46fdcad69fe9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69ff0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380490.010546:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0200/0xcf3c46fdcad69fe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69ff0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380490.010555:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787380490.010558:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6ec3e05800 from 8 10000000:01000000:2.0:1787380490.010560:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787380490.010586:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380490.010595:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380490.010603:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ff7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380490.010621:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867523328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787380490.010663:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380490.010877:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb833600 going to sleep for 11 seconds 00000100:00100000:1.0:1787380490.010962:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867523328 00000100:00100000:1.0:1787380490.010968:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867523328 00000100:00100000:1.0:1787380490.011004:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787380490.011010:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17196:x1874203867523328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380490.011019:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380490.011030:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ec3df1e00/0xcf3c46fdcad69ffe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad69ff7 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380490.011051:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ec3df1e00/0xcf3c46fdcad69ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad69ff7 expref: 18 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380490.011074:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ec3df1e00/0xcf3c46fdcad69ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69ff7 expref: 18 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380490.011082:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df1e00, rc 0) 00000100:00100000:1.0:1787380490.011114:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17196:x1874203867523328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380490.011121:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787380490.011302:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867523328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380490.011315:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ff7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69ffe expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380490.011335:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ff7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad69ffe expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380490.011380:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867523456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787380490.011425:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380490.011451:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb833600 going to sleep for 11 seconds 00000100:00100000:1.0:1787380490.011502:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867523456 00000100:00100000:1.0:1787380490.011514:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867523456 00000100:00100000:1.0:1787380490.011542:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787380490.011548:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17196:x1874203867523456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787380490.011558:0:17193:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787380490.011570:0:17193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787380490.011573:0:17193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787380490.011650:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17196:x1874203867523456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380490.011657:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787380490.012020:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867523456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787380490.012066:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787380490.012073:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ff7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69ffe expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380490.012083:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69ffe expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380490.127521:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380490.571896:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00000040:00080000:3.0:1787380490.831717:0:17958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787380491.156383:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380491.596291:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00010000:00010000:0.0:1787380492.172149:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380492.619887:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00010000:00010000:2.0:1787380493.199852:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787380493.493510:0:18201:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787380493.644491:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 0 seconds 00000100:00080000:0.0:1787380493.963969:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787380493.963976:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787380493.963979:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3d45000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787380493.963990:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9d6ec3d45000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1787380493.964023:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6fc43eb100 x1874203867523712/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787380493.964041:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380493.964045:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787380493.964048:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380493.964051:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787380493.964076:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380493.964079:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787380493.964081:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380493.964084:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787380493.964116:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867523712:0@lo:38:kworker.0 00000100:00100000:0.0:1787380493.964208:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380493.964287:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867523840:0@lo:400:kworker.0 00000100:00100000:0.0:1787380493.964314:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380493.964333:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380493.964338:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867523968:0@lo:400:kworker.0 00000100:00100000:0.0:1787380493.964359:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380493.964386:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867523712 00000100:00100000:0.0:1787380493.964392:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867523712 00000100:00100000:0.0:1787380493.964419:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867523968 00000100:00100000:0.0:1787380493.964421:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867523968 00000100:00100000:0.0:1787380493.964443:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787380493.964464:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3638:x1874203867523712:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787380493.964489:0:17204:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:0.0:1787380493.964523:0:17204:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3c46fdcad6a005 00000004:00100000:0.0:1787380493.964537:0:17204:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787380493.964542:0:17204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1787380493.964624:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787380493.964632:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867523968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380493.964683:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867523968:12345-0@lo:400:kworker.0 Request processed in 51us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380493.964690:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787380493.964730:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867523968:0@lo:400:kworker.0 00000100:00100000:1.0:1787380493.965229:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867524096:0@lo:400:kworker.0 00000100:00100000:1.0:1787380493.965270:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380493.965302:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787380493.965309:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867523584:0@lo:400:kworker.0 00000100:00100000:1.0:1787380493.965335:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380493.965373:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867523584 00000100:00100000:1.0:1787380493.965378:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867523584 00000100:00100000:1.0:1787380493.965409:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787380493.965426:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:3641:x1874203867523584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380493.965475:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:3641:x1874203867523584:12345-0@lo:400:kworker.0 Request processed in 50us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380493.965483:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787380493.965519:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867523584:0@lo:400:kworker.0 00000100:00100000:3.0:1787380493.965740:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867523840 00000100:00100000:3.0:1787380493.965745:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867523840 00000100:00100000:3.0:1787380493.965790:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867524096 00000100:00100000:3.0:1787380493.965800:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867524096 00000100:00100000:3.0:1787380493.965844:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380493.965851:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867523840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380493.965894:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867523840:12345-0@lo:400:kworker.0 Request processed in 43us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380493.965900:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380493.965912:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787380493.965917:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867524096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380493.965946:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867524096:12345-0@lo:400:kworker.0 Request processed in 30us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380493.965952:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787380493.965982:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fc43ead80 x1874203867523840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380493.965993:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867523840:0@lo:400:kworker.0 00010000:00080000:3.0:1787380493.966031:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6fc43e9180 x1874203867524096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380493.966040:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867524096:0@lo:400:kworker.0 00000100:00100000:3.0:1787380493.975793:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867524224:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380493.975872:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787380493.981632:0:17204:0:(import.c:65:import_set_state_nolock()) ffff9d6fc2bd8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380493.981730:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1874203867523712:12345-0@lo:38:kworker.0 Request processed in 17277us (17520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380493.981741:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787380493.981764:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867524224 00000100:00100000:1.0:1787380493.981771:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867524224 00000100:00100000:1.0:1787380493.981805:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787380493.981833:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867524224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787380493.981860:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00080000:0.0:1787380493.981962:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787380493.981971:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1787380493.981976:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787380493.981978:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3d45000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1787380493.981993:0:3638:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ac67d2fa): req@ffff9d6ff4e33480 x1874203867516288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380493.982039:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867523712:0@lo:38:kworker.0 00000100:00100000:3.0:1787380493.989641:0:17240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380493.989674:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd1040180 going to sleep for 11 seconds 00000100:00100000:3.0:1787380493.989693:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867516288 00000100:00100000:3.0:1787380493.989700:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867516288 00000100:00100000:3.0:1787380493.989739:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787380493.989747:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17240:x1874203867516288:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787380493.989864:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17240:x1874203867516288:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 117us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380493.989872:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787380493.989912:0:17240:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17240:1874203867516288:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1787380493.989945:0:17240:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787380493.989996:0:17240:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17240:1874203867524352:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787380493.990035:0:17240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380493.990058:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd2415540 going to sleep for 11 seconds 00000100:00100000:3.0:1787380493.990068:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867524352 00000100:00100000:3.0:1787380493.990072:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867524352 00000100:00100000:3.0:1787380493.990089:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787380493.990095:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17240:x1874203867524352:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787380493.990187:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17240:x1874203867524352:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 92us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380493.990208:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787380493.990235:0:17240:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17240:1874203867524352:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787380493.990292:0:17240:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17240:1874203867524480:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787380493.990315:0:17240:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380493.990328:0:17240:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec249f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380493.990338:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867524480 00000100:00100000:3.0:1787380493.990341:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867524480 00000100:00100000:3.0:1787380493.990356:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787380493.990362:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17240:x1874203867524480:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787380493.990405:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17240:x1874203867524480:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 43us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380493.990420:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787380493.990442:0:17240:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17240:1874203867524480:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1787380493.990488:0:17240:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787380493.992263:0:17240:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787380493.992348:0:17240:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:3.0:1787380493.992353:0:17240:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:1.0:1787380493.993910:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867524224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 12070us (18029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380493.993924:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787380493.994030:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380493.994043:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867524608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787380493.994093:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380493.994127:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867524608 00000100:00100000:1.0:1787380493.994134:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867524608 00000100:00100000:1.0:1787380493.994175:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787380493.994183:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1874203867524608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380493.994221:0:17939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787380493.994270:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3640:x1874203867524608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380493.994285:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787380493.994311:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867524608:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787380493.994935:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867524224:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787380494.220994:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787380494.373952:0:18253:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787380494.377530:0:18253:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787380495.250953:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787380495.321616:0:18304:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787380495.322231:0:18304:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000080:1.0:1787380496.270853:0:18352:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffef612dfc0 00000020:00000080:1.0:1787380496.270869:0:18352:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787380496.270874:0:18352:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787380496.270882:0:18352:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef6130250 20000000:00000080:1.0:1787380496.270889:0:18352:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d6ffc2e9000 uarg=0000000000000000 20000000:01000000:1.0:1787380496.270931:0:18352:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787380496.271128:0:18352:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787380496.271133:0:18352:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00010000:00010000:0.0:1787380496.271771:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787380496.272340:0:18353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1787380496.272507:0:18352:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787380496.284043:0:18352:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787380496.284074:0:18352:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a00c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.284104:0:18352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ffb89ce00/0xcf3c46fdcad69eb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69eae expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.284113:0:18352:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69fb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69fb1 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.284120:0:18352:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a00c lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.284161:0:18352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69fb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad69fb1 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.284177:0:18352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69fb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad69fb1 expref: 17 pid: 17193 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380496.284199:0:18352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18352:1874203867524736:0@lo:104: 00000100:00100000:1.0:1787380496.284273:0:18352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787380496.284362:0:18352:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ffb89ce00/0xcf3c46fdcad69eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad69eae expref: 17 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.284370:0:18352:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6ffb89ce00/0xcf3c46fdcad69eb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad69eae expref: 17 pid: 17192 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380496.284379:0:18352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18352:1874203867524864:0@lo:104: 00000100:00100000:1.0:1787380496.284401:0:18352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380496.285046:0:18352:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576240 going to sleep for 11 seconds 00000100:00100000:3.0:1787380496.285510:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867524736 00000100:00100000:3.0:1787380496.285528:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867524736 00000100:00100000:0.0:1787380496.287224:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867524864 00000100:00100000:0.0:1787380496.287236:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867524864 00000100:00100000:0.0:1787380496.287273:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787380496.287282:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+4:18352:x1874203867524736:12345-0@lo:104: 00010000:00010000:0.0:1787380496.287298:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0e00/0xcf3c46fdcad69fb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad69fb8 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.287387:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787380496.287393:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+4:18352:x1874203867524736:12345-0@lo:104: Request processed in 113us (3120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380496.287400:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787380496.287416:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787380496.287422:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+3:18352:x1874203867524864:12345-0@lo:104: 00010000:00010000:0.0:1787380496.287429:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad69eae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad69eb5 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.287460:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787380496.287464:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+3:18352:x1874203867524864:12345-0@lo:104: Request processed in 44us (3064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380496.287470:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787380496.287486:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787380496.287501:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0e00/0xcf3c46fdcad69fb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad69fb8 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.287521:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df0e00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:0.0:1787380496.287525:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0e00/0xcf3c46fdcad69fb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad69fb8 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.287534:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0e00/0xcf3c46fdcad69fb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad69fb8 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380496.287541:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0e00/0xcf3c46fdcad69fb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad69fb8 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380496.287546:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1787380496.287682:0:18352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18352:1874203867524736:0@lo:104: 00000100:00100000:1.0:1787380496.287693:0:18352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18352:1874203867524864:0@lo:104: 00010000:00010000:1.0:1787380496.287716:0:18352:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a00c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.287843:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0e00/0xcf3c46fdcad69fb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69fb8 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.287850:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380496.287873:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0e00/0xcf3c46fdcad69fb1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69fb8 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.287880:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0e00/0xcf3c46fdcad69fb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69fb8 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.287893:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380496.287897:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad69eae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad69eb5 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.287902:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df0600 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:0.0:1787380496.287905:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad69eae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad69eb5 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.287923:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad69eae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad69eb5 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380496.287930:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad69eae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad69eb5 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380496.287935:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787380496.288020:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad69eae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69eb5 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.288026:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380496.288039:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad69eae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69eb5 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.288045:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad69eae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69eb5 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.288057:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380496.288059:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380496.288060:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380496.288076:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380496.288090:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3639:1874203867524992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380496.288128:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380496.288169:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867524992 00000100:00100000:0.0:1787380496.288174:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867524992 00010000:00010000:0.0:1787380496.288204:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69fb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad69fb1 expref: 18 pid: 17193 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380496.288227:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787380496.288240:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:3639:x1874203867524992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787380496.288251:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380496.288256:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69fb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad69fb1 expref: 18 pid: 17193 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.288268:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69fb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad69fb1 expref: 18 pid: 17193 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.288281:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fd0d0ee00/0xcf3c46fdcad69fb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad69fb1 expref: 18 pid: 17193 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380496.288293:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380496.288322:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:3639:x1874203867524992:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380496.288328:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787380496.288356:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3639:1874203867524992:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787380496.288485:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380496.288496:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867525120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787380496.288538:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380496.289087:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867525120 00000100:00100000:1.0:1787380496.289094:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867525120 00010000:00010000:1.0:1787380496.289113:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ffb89ce00/0xcf3c46fdcad69eb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad69eae expref: 17 pid: 17192 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380496.289172:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787380496.289181:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:3641:x1874203867525120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380496.289202:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380496.289207:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ffb89ce00/0xcf3c46fdcad69eb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad69eae expref: 17 pid: 17192 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.289217:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ffb89ce00/0xcf3c46fdcad69eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad69eae expref: 17 pid: 17192 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.289227:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffb89ce00/0xcf3c46fdcad69eb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad69eae expref: 17 pid: 17192 timeout: 606 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.289248:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a00c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.289256:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a00c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.289269:0:17184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a00c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.289276:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a00c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.289282:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a00c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.289288:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a00c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.289292:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df0a00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380496.289296:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a00c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.289302:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a00c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.289324:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a00c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380496.289333:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380496.289377:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+16:3641:x1874203867525120:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380496.289390:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787380496.289442:0:18352:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a00c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380496.289450:0:18352:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a00c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380496.289456:0:18352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a00c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18352 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380496.289738:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867525120:0@lo:103:ldlm_bl.0 00000040:00080000:2.0:1787380496.653191:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787380497.292100:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380498.068110:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380488/real 1787380488] req@ffff9d6ff4e31c00 x1874203867519488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380498 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380498.068136:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ff4e31c00 x1874203867519488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380498 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380498.068146:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380488/real 1787380488] req@ffff9d6ec3cb1c00 x1874203867519360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380498 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380498.068158:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ec3cb1c00 x1874203867519360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380498 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787380498.068182:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6feb639800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787380498.069026:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787380498.069032:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867519488:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787380498.069040:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ffb910000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787380498.073575:0:13734:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787380498.073581:0:13734:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787380498.073584:0:13734:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787380498.073587:0:13734:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787380498.073601:0:13734:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787380498.073604:0:13734:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787380498.073607:0:13734:0:(import.c:65:import_set_state_nolock()) ffff9d6ffb910000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787380498.073614:0:13734:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 498 00000100:00080000:3.0:1787380498.073633:0:13734:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787380498.073640:0:13734:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9d6ffb910000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1787380498.073659:0:13734:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff4e32300 x1874203867525760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787380498.073670:0:13734:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787380498.073673:0:13734:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787380498.073675:0:13734:0:(import.c:65:import_set_state_nolock()) ffff9d6feb639800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787380498.073678:0:13734:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 498 00000100:00080000:3.0:1787380498.073681:0:13734:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787380498.073684:0:13734:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d6feb639800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1787380498.073693:0:13734:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff4e30000 x1874203867525888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787380498.073735:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867525632:0@lo:400:kworker.0 00000100:00100000:3.0:1787380498.073793:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380498.073843:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787380498.073849:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867525248:0@lo:400:kworker.0 00000100:00100000:3.0:1787380498.073876:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380498.073901:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867526016:0@lo:400:kworker.0 00000100:00100000:3.0:1787380498.073923:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787380498.074329:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787380498.074335:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867519360:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1787380498.074348:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867525504:0@lo:400:kworker.0 00000100:00100000:1.0:1787380498.074379:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380498.074406:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380498.074412:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867525376:0@lo:400:kworker.0 00000100:00100000:1.0:1787380498.074432:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380498.074466:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867525632 00000100:00100000:1.0:1787380498.074473:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867525632 00000100:00100000:1.0:1787380498.074509:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867525376 00000100:00100000:1.0:1787380498.074519:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867525376 00000100:00100000:1.0:1787380498.074538:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787380498.074545:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867525632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380498.074590:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867525632:12345-0@lo:400:kworker.0 Request processed in 45us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380498.074597:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787380498.074612:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787380498.074617:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1874203867525376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380498.074643:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1874203867525376:12345-0@lo:400:kworker.0 Request processed in 26us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380498.074649:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787380498.074682:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867525376:0@lo:400:kworker.0 00000100:00100000:1.0:1787380498.074712:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867525760:0@lo:8:kworker.0 00000400:00000100:1.0:1787380498.074734:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874203867525760 offset 0 length 520: 4 00000100:00100000:1.0:1787380498.074752:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867525888:0@lo:8:kworker.0 00000400:00000100:1.0:1787380498.074768:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874203867525888 offset 0 length 520: 4 00000100:00100000:0.0:1787380498.074838:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867526016 00000100:00100000:0.0:1787380498.074843:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867526016 00000100:00100000:0.0:1787380498.074869:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867525504 00000100:00100000:0.0:1787380498.074871:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867525504 00000100:00100000:0.0:1787380498.074885:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787380498.074890:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867526016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380498.074923:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867526016:12345-0@lo:400:kworker.0 Request processed in 33us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380498.074929:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787380498.075098:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ff3fc1880 x1874203867526016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380498.075109:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867526016:0@lo:400:kworker.0 00000100:00100000:3.0:1787380498.075118:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867525632:0@lo:400:kworker.0 00000100:00100000:3.0:1787380498.075143:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867525248 00000100:00100000:3.0:1787380498.075153:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867525248 00000100:00100000:3.0:1787380498.075189:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787380498.075195:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+16:3641:x1874203867525248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380498.075230:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+16:3641:x1874203867525248:12345-0@lo:400:kworker.0 Request processed in 35us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380498.075236:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787380498.075265:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787380498.075272:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867525504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380498.075301:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867525504:12345-0@lo:400:kworker.0 Request processed in 30us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380498.075307:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787380498.075520:0:13734:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787380498.075524:0:13734:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787380498.075527:0:13734:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787380498.075530:0:13734:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787380498.075549:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867525248:0@lo:400:kworker.0 00010000:00080000:1.0:1787380498.076117:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ff4e30e00 x1874203867525504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380498.076128:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867525504:0@lo:400:kworker.0 10000000:01000000:0.0:1787380498.125092:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787380498.125100:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ff3daa800 from 13 10000000:01000000:0.0:1787380498.125105:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787380498.125163:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866200/0xcf3c46fdcad6a013 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380498.125184:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866200/0xcf3c46fdcad6a013 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380498.125194:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866200/0xcf3c46fdcad6a013 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380498.125217:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867526144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787380498.125279:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380498.125317:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb45d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787380498.125364:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867526144 00000100:00100000:1.0:1787380498.125372:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867526144 00000100:00100000:1.0:1787380498.125422:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787380498.125431:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+16:17196:x1874203867526144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380498.125443:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380498.125462:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ec3df0000/0xcf3c46fdcad6a01a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6a013 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380498.125482:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ec3df0000/0xcf3c46fdcad6a01a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a013 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380498.125493:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ec3df0000/0xcf3c46fdcad6a01a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a013 expref: 17 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380498.125501:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df0000, rc 0) 00000100:00100000:1.0:1787380498.125546:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17196:x1874203867526144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380498.125552:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787380498.125896:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867526144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380498.125911:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866200/0xcf3c46fdcad6a013 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a01a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380498.125919:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866200/0xcf3c46fdcad6a013 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad6a01a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380498.126053:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867526272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380498.126082:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380498.126111:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb45d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787380498.126152:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867526272 00000100:00100000:1.0:1787380498.126156:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867526272 00000100:00100000:1.0:1787380498.126193:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787380498.126200:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17196:x1874203867526272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380498.126303:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17196:x1874203867526272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380498.126310:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787380498.126407:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867526272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380498.126434:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867526400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380498.126472:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380498.126489:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb45d600 going to sleep for 11 seconds 00000100:00100000:1.0:1787380498.126530:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867526400 00000100:00100000:1.0:1787380498.126535:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867526400 00000100:00100000:1.0:1787380498.126567:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787380498.126573:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17196:x1874203867526400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787380498.126651:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17196:x1874203867526400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380498.126657:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787380498.126775:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867526400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787380498.128103:0:18432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787380498.129476:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787380498.129517:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787380498.129532:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866200/0xcf3c46fdcad6a013 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a01a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380498.129544:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866200/0xcf3c46fdcad6a013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a01a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787380498.129556:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787380498.129559:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ec3e05800 from 13 10000000:01000000:2.0:1787380498.129562:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787380498.129599:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e800/0xcf3c46fdcad6a021 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380498.129607:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e800/0xcf3c46fdcad6a021 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380498.129616:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e800/0xcf3c46fdcad6a021 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380498.129638:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867526528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787380498.129699:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380498.129736:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb76540 going to sleep for 11 seconds 00000100:00100000:0.0:1787380498.129882:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867526528 00000100:00100000:0.0:1787380498.129889:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867526528 00000100:00100000:0.0:1787380498.129932:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787380498.129953:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+17:17196:x1874203867526528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380498.129965:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380498.129976:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad6a028 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6a021 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380498.129998:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad6a028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a021 expref: 18 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380498.130008:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad6a028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a021 expref: 18 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380498.130016:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867000, rc 0) 00000100:00100000:0.0:1787380498.130061:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17196:x1874203867526528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380498.130067:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787380498.130214:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867526528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380498.130229:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e800/0xcf3c46fdcad6a021 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a028 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380498.130236:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e800/0xcf3c46fdcad6a021 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad6a028 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380498.130290:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867526656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380498.130329:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380498.130357:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec3378cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380498.130408:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867526656 00000100:00100000:2.0:1787380498.130412:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867526656 00000100:00100000:2.0:1787380498.130443:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787380498.130450:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17196:x1874203867526656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380498.130547:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17196:x1874203867526656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380498.130554:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787380498.130588:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867526656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787380498.130613:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867526784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380498.130648:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380498.130661:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffcb760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380498.130671:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867526784 00000100:00100000:2.0:1787380498.130674:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867526784 00000100:00100000:2.0:1787380498.130689:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787380498.130694:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17196:x1874203867526784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787380498.130759:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:17196:x1874203867526784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380498.130766:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787380498.130801:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867526784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787380498.131720:0:18433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787380498.132921:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787380498.132961:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787380498.132972:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e800/0xcf3c46fdcad6a021 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a028 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380498.132984:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e800/0xcf3c46fdcad6a021 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a028 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380498.320934:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380499.085085:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380499.085105:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867526912:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787380499.085181:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380499.085223:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867526912 00000100:00100000:2.0:1787380499.085230:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867526912 00000100:00100000:2.0:1787380499.085278:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787380499.085297:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1874203867526912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787380499.085332:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787380499.085380:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3640:x1874203867526912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380499.085387:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787380499.085452:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867526912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787380499.086545:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380499.086571:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867527040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380499.086620:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380499.086756:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867527040 00000100:00100000:0.0:1787380499.086762:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867527040 00000100:00100000:0.0:1787380499.086804:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787380499.086839:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867527040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787380499.086867:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787380499.086909:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867527040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380499.086916:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787380499.087074:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867527040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380499.089871:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380484/real 1787380484] req@ffff9d6ff4e33100 x1874203867517440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380499 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380499.089910:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ff4e33100 x1874203867517440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380499 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380499.089934:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380484/real 1787380484] req@ffff9d6ff4e32a00 x1874203867517568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380499 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380499.089945:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ff4e32a00 x1874203867517568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380499 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787380499.089962:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6fd1713000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787380499.089983:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787380499.089988:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867517440:0@lo:8:kworker.0 00000100:00080000:0.0:1787380499.089993:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec231e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787380499.089998:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787380499.090001:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867517568:0@lo:8:kworker.0 00000100:00080000:2.0:1787380499.090187:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787380499.090192:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787380499.090195:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d6fd1713000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787380499.090199:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:2.0:1787380499.090203:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787380499.090209:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d6fd1713000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:2.0:1787380499.090230:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3cb2300 x1874203867527296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787380499.090242:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787380499.090244:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787380499.090246:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d6ec231e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787380499.090249:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 495 00000100:00080000:2.0:1787380499.090252:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787380499.090254:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d6ec231e000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:2.0:1787380499.090264:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3cb2680 x1874203867527424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787380499.090281:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787380499.090284:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787380499.090293:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787380499.090296:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787380499.090332:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867527552:0@lo:400:kworker.0 00000100:00100000:2.0:1787380499.090393:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380499.090438:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787380499.090444:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3642:1874203867527168:0@lo:400:kworker.0 00000100:00100000:2.0:1787380499.090471:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380499.090507:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867527168 00000100:00100000:2.0:1787380499.090514:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867527168 00000100:00100000:2.0:1787380499.090552:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787380499.090742:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:3642:x1874203867527168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380499.090790:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:3642:x1874203867527168:12345-0@lo:400:kworker.0 Request processed in 230us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380499.090797:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787380499.090870:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3642:1874203867527168:0@lo:400:kworker.0 00000100:00100000:2.0:1787380499.090888:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787380499.090895:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867527680:0@lo:400:kworker.0 00000100:00100000:2.0:1787380499.090928:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380499.091061:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867527552 00000100:00100000:0.0:1787380499.091066:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867527552 00000100:00100000:0.0:1787380499.091104:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867527680 00000100:00100000:0.0:1787380499.091108:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867527680 00000100:00100000:0.0:1787380499.091122:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787380499.091129:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867527552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380499.091182:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867527552:12345-0@lo:400:kworker.0 Request processed in 53us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380499.091189:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787380499.091203:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787380499.091210:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867527680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380499.091257:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867527680:12345-0@lo:400:kworker.0 Request processed in 47us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380499.091263:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787380499.091283:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867527296:0@lo:8:kworker.0 00000400:00000100:0.0:1787380499.091307:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874203867527296 offset 0 length 520: 4 00000100:00100000:0.0:1787380499.091326:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867527424:0@lo:8:kworker.0 00000400:00000100:0.0:1787380499.091346:0:3638:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874203867527424 offset 0 length 520: 4 00010000:00080000:0.0:1787380499.091376:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ec3cb0a80 x1874203867527552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380499.091386:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867527552:0@lo:400:kworker.0 00010000:00080000:0.0:1787380499.091433:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9d6ec3cb3100 x1874203867527680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380499.091442:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867527680:0@lo:400:kworker.0 00010000:00010000:2.0:1787380499.342925:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787380499.599026:0:17931:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:1.0:1787380500.044545:0:17958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787380500.365072:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380501.390117:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380502.417399:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787380503.187491:0:18700:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787380503.187495:0:18700:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787380503.187497:0:18700:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1787380503.187596:0:18700:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d6fff5a6800 00000020:01000004:2.0:1787380503.187612:0:18700:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787380503.187623:0:18700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787380503.187641:0:18700:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9d6ffc293380) 00000020:00000080:2.0:1787380503.187658:0:18700:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787380503.230796:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787380503.233696:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787380503.234080:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787380503.234275:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787380503.234698:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787380503.234990:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787380503.235198:0:18700:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:1.0:1787380503.236444:0:18700:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787380503.236642:0:18700:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787380503.236655:0:18700:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787380503.236667:0:18700:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf3c46fdcad6a036 00000020:01000004:1.0:1787380503.236674:0:18700:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787380503.236695:0:18700:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.130@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787380503.236699:0:18700:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787380503.236705:0:18700:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787380503.236709:0:18700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787380503.236722:0:18700:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9d6feb450000) 00000020:00000080:1.0:1787380503.236733:0:18700:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1787380503.238228:0:18700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787380503.238387:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1787380503.238392:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787380503.244528:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787380503.244539:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787380503.245001:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787380503.245008:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787380503.246566:0:18700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787380503.246729:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787380503.246747:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787380503.247485:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787380503.247494:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787380503.274725:0:18700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787380503.275404:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787380503.275410:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787380503.283854:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787380503.283868:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787380503.284688:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787380503.284697:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787380503.287326:0:18700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787380503.287487:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787380503.287492:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787380503.288382:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787380503.288390:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787380503.336478:0:18700:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787380503.336646:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787380503.336653:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787380503.340119:0:18700:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787380503.340131:0:18700:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787380503.340611:0:18700:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787380503.340639:0:18700:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1787380503.340644:0:18700:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.130@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787380503.356207:0:18700:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.130@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787380503.356248:0:18700:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.130@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787380503.356252:0:18700:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787380503.356253:0:18700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787380503.356255:0:18700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787380503.356256:0:18700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787380503.356257:0:18700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787380503.356259:0:18700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787380503.356260:0:18700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787380503.356262:0:18700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787380503.356263:0:18700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787380503.356267:0:18700:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787380503.356269:0:18700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787380503.356270:0:18700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787380503.356271:0:18700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787380503.356273:0:18700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787380503.356274:0:18700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787380503.356281:0:18700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787380503.356282:0:18700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787380503.356283:0:18700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787380503.356284:0:18700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787380503.356311:0:18700:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787380503.356330:0:18700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867527808:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787380503.356390:0:18700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380503.356429:0:18700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4e25000 going to sleep for 11 seconds 00000100:00100000:0.0:1787380503.356513:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867527808 00000100:00100000:0.0:1787380503.356521:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867527808 00000100:00100000:0.0:1787380503.356570:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787380503.356579:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:18700:x1874203867527808:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787380503.356606:0:17192:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787380503.356609:0:17192:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787380503.356613:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787380503.357063:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:18700:x1874203867527808:12345-0@lo:253:mount.lustre.0 Request processed in 483us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380503.357083:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787380503.357184:0:18700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867527808:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787380503.357196:0:18700:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787380503.357198:0:18700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787380503.357199:0:18700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787380503.357200:0:18700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787380503.357200:0:18700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787380503.357201:0:18700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787380503.357202:0:18700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787380503.357204:0:18700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787380503.357205:0:18700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787380503.357206:0:18700:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787380503.357222:0:18700:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d6fff5a6800 from lustre-OST0000 10000000:01000000:3.0:1787380503.357246:0:18700:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787380503.357249:0:18700:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787380503.357256:0:18700:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d6ec34f3380 local copy 00010000:00010000:3.0:1787380503.357265:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69df1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69df8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380503.357349:0:18700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867527936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787380503.357378:0:18700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380503.357412:0:18700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fb9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787380503.357461:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867527936 00000100:00100000:0.0:1787380503.357466:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867527936 00000100:00100000:0.0:1787380503.357498:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787380503.357506:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:18700:x1874203867527936:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380503.357574:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:18700:x1874203867527936:12345-0@lo:501:mount.lustre.0 Request processed in 69us (194us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787380503.357581:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787380503.357688:0:18700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867527936:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787380503.357699:0:18700:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787380503.357715:0:18700:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787380503.357726:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69df1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69df8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380503.357734:0:18700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69df1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69df8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380503.357769:0:18700:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d6fff5a6800 10000000:01000000:3.0:1787380503.357773:0:18700:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787380503.357778:0:18700:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787380503.357780:0:18700:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787380503.357784:0:18700:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787380503.357787:0:18700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787380503.357845:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d600/0xcf3c46fdcad6a044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380503.357853:0:18700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d600/0xcf3c46fdcad6a044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380503.357861:0:18700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d600/0xcf3c46fdcad6a044 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380503.357875:0:18700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867528064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787380503.357910:0:18700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380503.357926:0:18700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fb9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787380503.358160:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867528064 00000100:00100000:0.0:1787380503.358165:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867528064 00000100:00100000:0.0:1787380503.358198:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787380503.358205:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+18:18700:x1874203867528064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787380503.358215:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380503.358226:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7867200/0xcf3c46fdcad6a04b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6a044 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380503.358247:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7867200/0xcf3c46fdcad6a04b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a044 expref: 19 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380503.358257:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7867200/0xcf3c46fdcad6a04b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a044 expref: 19 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380503.358266:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867200, rc 0) 00000100:00100000:0.0:1787380503.358304:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+19:18700:x1874203867528064:12345-0@lo:101:mount.lustre.0 Request processed in 99us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380503.358310:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787380503.358392:0:18700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867528064:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787380503.358405:0:18700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d600/0xcf3c46fdcad6a044 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a04b expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380503.358412:0:18700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d600/0xcf3c46fdcad6a044 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad6a04b expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787380503.359939:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787380503.360709:0:18700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787380503.362603:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787380503.362658:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787380503.362673:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787380503.362685:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787380503.362697:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787380503.362709:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787380503.362730:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787380503.364012:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787380503.364125:0:18700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867528192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380503.364199:0:18700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380503.364246:0:18700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feeb883c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787380503.364871:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867528192 00000100:00100000:0.0:1787380503.364891:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867528192 00000100:00100000:0.0:1787380503.365045:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787380503.365053:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+19:18700:x1874203867528192:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380503.365269:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+19:18700:x1874203867528192:12345-0@lo:501:mount.lustre.0 Request processed in 216us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380503.365278:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787380503.369165:0:18700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867528192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380503.371089:0:18700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867528320:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787380503.371181:0:18700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380503.371219:0:18700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feeb88e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380503.371365:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867528320 00000100:00100000:3.0:1787380503.371373:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867528320 00000100:00100000:3.0:1787380503.371424:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787380503.371434:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+19:18700:x1874203867528320:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787380503.372428:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+19:18700:x1874203867528320:12345-0@lo:503:mount.lustre.0 Request processed in 991us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380503.372438:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787380503.372534:0:18700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867528320:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787380503.372999:0:18700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787380503.373073:0:18700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867528448:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380503.373119:0:18700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380503.373156:0:18700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feeb88d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787380503.373271:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867528448 00000100:00100000:0.0:1787380503.373277:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867528448 00000100:00100000:0.0:1787380503.373318:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787380503.373326:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+19:18700:x1874203867528448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787380503.373757:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+19:18700:x1874203867528448:12345-0@lo:502:mount.lustre.0 Request processed in 430us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380503.373765:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787380503.374067:0:18700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867528448:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787380503.374268:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787380503.374294:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787380503.374307:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787380503.374319:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787380503.374332:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787380503.374344:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787380503.374356:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787380503.374369:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787380503.374380:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1787380503.374392:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1787380503.374403:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1787380503.374416:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1787380503.374445:0:18700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867528576:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787380503.374486:0:18700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380503.374513:0:18700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fb9000 going to sleep for 11 seconds 00000100:00100000:2.0:1787380503.374586:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867528576 00000100:00100000:2.0:1787380503.374592:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867528576 00000100:00100000:2.0:1787380503.374630:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787380503.374638:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+19:18700:x1874203867528576:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380503.374718:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+19:18700:x1874203867528576:12345-0@lo:502:mount.lustre.0 Request processed in 80us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380503.374724:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787380503.375090:0:18700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867528576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787380503.375133:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787380503.375140:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1787380503.381085:0:18717:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787380503.381098:0:18717:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1787380503.381105:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380503.381107:0:18717:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787380503.381114:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787380503.381129:0:18717:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9d6ff4f73380) 00000020:00000080:3.0:1787380503.381161:0:18717:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787380503.381167:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787380503.381264:0:18717:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6fff5a6800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787380503.381273:0:18717:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787380503.381284:0:18717:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcf3c46fdcad6a059 00010000:00010000:0.0:1787380503.391805:0:18717:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1787380503.392469:0:18717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967326 00080000:10000000:0.0:1787380503.394105:0:18717:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1787380503.395483:0:18717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787380503.395493:0:18717:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380503.395499:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380503.395502:0:18717:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787380503.395505:0:18717:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787380503.395508:0:18717:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1787380503.395510:0:18717:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787380503.395511:0:18717:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787380503.395513:0:18717:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787380503.395516:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380503.395522:0:18717:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787380503.395526:0:18717:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380503.395530:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380503.395531:0:18717:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787380503.395534:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787380503.395536:0:18717:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787380503.395538:0:18717:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380503.395540:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380503.395542:0:18717:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787380503.395544:0:18717:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380503.395545:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380503.395547:0:18717:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787380503.395550:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787380503.395575:0:18717:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380503.395577:0:18717:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380503.395579:0:18717:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787380503.395582:0:18717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787380503.395722:0:18700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787380503.396012:0:18700:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787380503.396036:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d600/0xcf3c46fdcad6a044 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a04b expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380503.396048:0:18700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d600/0xcf3c46fdcad6a044 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a04b expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380503.396057:0:18700:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fff5a6800 from 1 10000000:01000000:3.0:1787380503.396059:0:18700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787380503.396093:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad6a060 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380503.396102:0:18700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad6a060 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380503.396113:0:18700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad6a060 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380503.396138:0:18700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867528704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787380503.396214:0:18700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380503.396340:0:18700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fb9780 going to sleep for 11 seconds 00000100:00100000:1.0:1787380503.398509:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867528704 00000100:00100000:1.0:1787380503.398521:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867528704 00000100:00100000:1.0:1787380503.398577:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787380503.398587:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+19:18700:x1874203867528704:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380503.398603:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380503.398618:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ec3df1000/0xcf3c46fdcad6a067 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6a060 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.398642:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ec3df1000/0xcf3c46fdcad6a067 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a060 expref: 20 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.398662:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ec3df1000/0xcf3c46fdcad6a067 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a060 expref: 20 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.398671:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df1000, rc 0) 00000100:00100000:1.0:1787380503.398750:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+20:18700:x1874203867528704:12345-0@lo:101:mount.lustre.0 Request processed in 152us (2523us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380503.398757:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787380503.398831:0:18700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867528704:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380503.398847:0:18700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad6a060 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a067 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.398857:0:18700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad6a060 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad6a067 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787380503.400457:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787380503.400692:0:18700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787380503.401118:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787380503.401156:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787380503.401178:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787380503.401183:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787380503.401251:0:18700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867528832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380503.401313:0:18700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380503.401359:0:18700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc85760c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380503.401417:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867528832 00000100:00100000:1.0:1787380503.401424:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867528832 00000100:00100000:1.0:1787380503.401504:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787380503.401514:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+20:18700:x1874203867528832:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380503.401609:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+20:18700:x1874203867528832:12345-0@lo:501:mount.lustre.0 Request processed in 97us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380503.401616:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787380503.401682:0:18700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867528832:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380503.401711:0:18700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867528960:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787380503.401747:0:18700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380503.404163:0:18700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc85760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380503.404250:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867528960 00000100:00100000:2.0:1787380503.404259:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867528960 00000100:00100000:2.0:1787380503.404305:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787380503.404313:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+20:18700:x1874203867528960:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787380503.404453:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+20:18700:x1874203867528960:12345-0@lo:503:mount.lustre.0 Request processed in 140us (2704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380503.404461:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787380503.406500:0:18700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867528960:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787380503.407005:0:18700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787380503.407097:0:18700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867529088:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787380503.407173:0:18700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380503.407211:0:18700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc85760c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380503.407352:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867529088 00000100:00100000:1.0:1787380503.407359:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867529088 00000100:00100000:1.0:1787380503.407396:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787380503.407404:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+20:18700:x1874203867529088:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787380503.407515:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+20:18700:x1874203867529088:12345-0@lo:502:mount.lustre.0 Request processed in 111us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380503.407522:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787380503.407707:0:18700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867529088:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787380503.408115:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787380503.408142:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787380503.408169:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787380503.408182:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787380503.408193:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787380503.408204:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787380503.408216:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787380503.408227:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1787380503.408238:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787380503.408251:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1787380503.408279:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1787380503.408305:0:18700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867529216:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787380503.408341:0:18700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380503.408423:0:18700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc85760c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380503.408562:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867529216 00000100:00100000:3.0:1787380503.408568:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867529216 00000100:00100000:1.0:1787380503.408618:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787380503.408627:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+20:18700:x1874203867529216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787380503.408714:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+20:18700:x1874203867529216:12345-0@lo:502:mount.lustre.0 Request processed in 88us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380503.408722:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787380503.408806:0:18700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867529216:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787380503.412440:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1787380503.412457:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1787380503.413183:0:18721:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380503.413192:0:18721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380503.413194:0:18721:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787380503.413200:0:18721:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6fff5a6800 00000020:00000080:0.0:1787380503.413202:0:18721:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787380503.413209:0:18721:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380503.413212:0:18721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380503.413213:0:18721:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787380503.413226:0:18721:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380503.413230:0:18721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380503.413231:0:18721:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787380503.413234:0:18721:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6fff5a6800 00000020:00000080:0.0:1787380503.413236:0:18721:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787380503.413290:0:18721:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380503.413294:0:18721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380503.413295:0:18721:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787380503.413297:0:18721:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380503.413300:0:18721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380503.413301:0:18721:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787380503.413304:0:18721:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6fff5a6800 00000020:00000080:0.0:1787380503.413306:0:18721:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787380503.413324:0:18721:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380503.413327:0:18721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380503.413328:0:18721:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787380503.413330:0:18721:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787380503.413332:0:18721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380503.413333:0:18721:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787380503.413336:0:18721:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6fff5a6800 00000020:00000080:0.0:1787380503.413338:0:18721:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787380503.413358:0:18721:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787380503.413361:0:18721:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380503.413363:0:18721:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787380503.413365:0:18721:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1787380503.420138:0:18700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787380503.420192:0:18700:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787380503.420211:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad6a060 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a067 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380503.420224:0:18700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad6a060 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a067 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380503.420284:0:18700:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787380503.420287:0:18700:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d6fff5a6800 10000000:01000000:3.0:1787380503.420290:0:18700:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d6fff5a6800 10000000:01000000:3.0:1787380503.420293:0:18700:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787380503.420299:0:18700:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6fff5a6800 from 1 10000000:01000000:3.0:1787380503.420302:0:18700:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787380503.420332:0:18700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c600/0xcf3c46fdcad6a06e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380503.420341:0:18700:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c600/0xcf3c46fdcad6a06e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380503.420351:0:18700:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c600/0xcf3c46fdcad6a06e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380503.420374:0:18700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867529344:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787380503.420433:0:18700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380503.420471:0:18700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fb9840 going to sleep for 11 seconds 00000100:00100000:1.0:1787380503.420530:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867529344 00000100:00100000:1.0:1787380503.420537:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867529344 00000100:00100000:1.0:1787380503.420583:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787380503.420592:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+20:18700:x1874203867529344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380503.420603:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380503.420615:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ec3df0c00/0xcf3c46fdcad6a075 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6a06e expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.420637:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ec3df0c00/0xcf3c46fdcad6a075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a06e expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.420648:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ec3df0c00/0xcf3c46fdcad6a075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a06e expref: 21 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.420656:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df0c00, rc 0) 00000100:00100000:1.0:1787380503.420689:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:18700:x1874203867529344:12345-0@lo:101:mount.lustre.0 Request processed in 99us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380503.420696:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787380503.421008:0:18700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867529344:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787380503.421021:0:18700:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c600/0xcf3c46fdcad6a06e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a075 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380503.421030:0:18700:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c600/0xcf3c46fdcad6a06e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad6a075 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787380503.422730:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787380503.423058:0:18700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787380503.423246:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787380503.423278:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787380503.423292:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787380503.423306:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787380503.423319:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787380503.423330:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787380503.423344:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787380503.423355:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787380503.423367:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787380503.423378:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787380503.423390:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787380503.423401:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787380503.423415:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787380503.423426:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787380503.423437:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787380503.423462:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787380503.423478:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787380503.423491:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787380503.423502:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787380503.423513:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787380503.423525:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787380503.423535:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787380503.423546:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787380503.423558:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787380503.423569:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1787380503.423580:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1787380503.423591:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1787380503.423603:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1787380503.423615:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1787380503.423626:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1787380503.423638:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1787380503.423661:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1787380503.423674:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1787380503.423686:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1787380503.423704:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1787380503.423716:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1787380503.423727:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1787380503.423742:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1787380503.423747:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787380503.423843:0:18700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867529472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787380503.425397:0:18700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380503.425453:0:18700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fb99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380503.425998:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867529472 00000100:00100000:2.0:1787380503.426006:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867529472 00000100:00100000:2.0:1787380503.426049:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787380503.426057:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:18700:x1874203867529472:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380503.426207:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:18700:x1874203867529472:12345-0@lo:501:mount.lustre.0 Request processed in 149us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380503.426215:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787380503.426311:0:18700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867529472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787380503.426352:0:18700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867529600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787380503.426391:0:18700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380503.426418:0:18700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fb99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380503.426971:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867529600 00000100:00100000:2.0:1787380503.426977:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867529600 00000100:00100000:2.0:1787380503.427011:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787380503.427018:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:18700:x1874203867529600:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787380503.427102:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:18700:x1874203867529600:12345-0@lo:503:mount.lustre.0 Request processed in 83us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380503.427109:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787380503.427159:0:18700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867529600:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787380503.427514:0:18700:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787380503.427579:0:18700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867529728:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380503.427617:0:18700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380503.427638:0:18700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a4480 going to sleep for 11 seconds 00000100:00100000:3.0:1787380503.429335:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867529728 00000100:00100000:3.0:1787380503.429346:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867529728 00000100:00100000:3.0:1787380503.429391:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787380503.429399:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff63a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:18700:x1874203867529728:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787380503.429522:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff63a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:18700:x1874203867529728:12345-0@lo:502:mount.lustre.0 Request processed in 123us (1904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380503.429530:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787380503.429667:0:18700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867529728:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787380503.430239:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787380503.430270:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787380503.430282:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787380503.430293:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787380503.430305:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787380503.430316:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787380503.430328:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787380503.430340:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787380503.430365:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787380503.430381:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787380503.430393:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787380503.430405:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787380503.430418:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787380503.430431:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787380503.430443:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787380503.430454:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787380503.430466:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787380503.430478:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787380503.430489:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787380503.430500:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787380503.430511:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787380503.430522:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787380503.430533:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787380503.430546:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787380503.430568:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1787380503.430581:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1787380503.430593:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1787380503.430605:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1787380503.430617:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1787380503.430630:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1787380503.430642:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1787380503.430655:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1787380503.430680:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1787380503.430692:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1787380503.430703:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1787380503.430714:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1787380503.430726:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1787380503.430738:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1787380503.430749:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1787380503.430761:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1787380503.430786:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1787380503.430802:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1787380503.430842:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1787380503.430855:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1787380503.430868:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1787380503.430879:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1787380503.430892:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1787380503.433864:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1787380503.435024:0:18700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867529856:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380503.435096:0:18700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380503.435141:0:18700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a4480 going to sleep for 11 seconds 00000100:00100000:2.0:1787380503.436022:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867529856 00000100:00100000:2.0:1787380503.436031:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867529856 00000100:00100000:2.0:1787380503.436075:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787380503.436084:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff63ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:18700:x1874203867529856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380503.436230:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff63ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:18700:x1874203867529856:12345-0@lo:502:mount.lustre.0 Request processed in 146us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380503.436238:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787380503.436293:0:18700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867529856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787380503.436479:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1787380503.436505:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1787380503.436540:0:18700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867529984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380503.436580:0:18700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380503.436607:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867529984 00000100:00100000:2.0:1787380503.436611:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867529984 00000100:00100000:2.0:1787380503.436633:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787380503.436639:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:18700:x1874203867529984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380503.436701:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:18700:x1874203867529984:12345-0@lo:502:mount.lustre.0 Request processed in 61us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380503.436708:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787380503.436749:0:18700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a4480 going to sleep for 11 seconds 00000100:00100000:2.0:1787380503.436762:0:18700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867529984:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787380503.436796:0:18700:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1787380503.436804:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00010000:00010000:1.0:1787380503.436919:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787380503.444094:0:18726:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787380503.444110:0:18726:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9d6feb4519c0) 00000020:00000080:1.0:1787380503.444133:0:18726:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1787380503.444306:0:18726:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6fff5a6800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787380503.444310:0:18726:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6fff5a6800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787380503.444313:0:18726:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6fff5a6800 3 00010000:00080000:1.0:1787380503.444340:0:18726:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ec10c7800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.130@tcp at head 00010000:00010000:1.0:1787380503.449106:0:18726:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1787380503.449216:0:18726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787380503.449260:0:18726:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787380503.449272:0:18726:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcf3c46fdcad6a083 00000100:00080000:1.0:1787380503.449282:0:18726:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787380503.449287:0:18726:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9d6ec10c7800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:1.0:1787380503.449319:0:18726:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3f8e680 x1874203867530112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787380503.449382:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1874203867530112:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787380503.449443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380503.449505:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867530112 00000100:00100000:1.0:1787380503.449512:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867530112 00000100:00100000:1.0:1787380503.449539:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787380503.449545:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1874203867530112:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787380503.449566:0:17200:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:1.0:1787380503.449601:0:17200:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcf3c46fdcad6a08a 00000004:00100000:1.0:1787380503.449615:0:17200:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787380503.449640:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9d6ec10c1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380503.449688:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1874203867530112:12345-0@lo:38:llog_process_th.0 Request processed in 141us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380503.449703:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787380503.449741:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec3f8e680 x1874203867530112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787380513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380503.449750:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787380503.449757:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787380503.449763:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787380503.449767:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787380503.449769:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec10c7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787380503.449774:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3638:1874203867530112:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787380503.449792:0:18726:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787380503.449859:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787380503.449863:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787380503.449866:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787380503.449869:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787380503.449891:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787380503.457997:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787380503.458004:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787380503.458007:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787380503.458073:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867530240:0@lo:400:kworker.0 00000100:00100000:1.0:1787380503.458134:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380503.458178:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380503.458185:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867530624:0@lo:400:kworker.0 00000100:00100000:1.0:1787380503.458217:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380503.458254:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867530368:0@lo:400:kworker.0 00000100:00100000:1.0:1787380503.458275:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380503.458290:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787380503.458295:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867530496:0@lo:400:kworker.0 00000100:00100000:1.0:1787380503.458317:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380503.458351:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867530240 00000100:00100000:1.0:1787380503.458358:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867530240 00000100:00100000:1.0:1787380503.458394:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867530496 00000100:00100000:1.0:1787380503.458397:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867530496 00000100:00100000:1.0:1787380503.458413:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787380503.458419:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867530240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380503.458467:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867530240:12345-0@lo:400:kworker.0 Request processed in 47us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380503.458475:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787380503.458489:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787380503.458494:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867530496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380503.458524:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867530496:12345-0@lo:400:kworker.0 Request processed in 29us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380503.458529:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787380503.458546:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867530624 00000100:00100000:1.0:1787380503.458548:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867530624 00000100:00100000:1.0:1787380503.458565:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867530368 00000100:00100000:1.0:1787380503.458568:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867530368 00000100:00100000:1.0:1787380503.458577:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787380503.458582:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867530624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380503.458608:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1874203867530624:12345-0@lo:400:kworker.0 Request processed in 25us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380503.458620:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787380503.458631:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787380503.458637:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867530368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380503.458664:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867530368:12345-0@lo:400:kworker.0 Request processed in 27us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380503.458669:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787380503.458709:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867530496:0@lo:400:kworker.0 00010000:00080000:1.0:1787380503.458720:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec3f8f800 x1874203867530368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380503.458729:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867530368:0@lo:400:kworker.0 00010000:00080000:1.0:1787380503.458754:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec3f8c380 x1874203867530624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380503.458762:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3640:1874203867530624:0@lo:400:kworker.0 00000100:00100000:1.0:1787380503.458771:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867530240:0@lo:400:kworker.0 00000020:01000004:1.0:1787380503.460252:0:18726:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787380503.460267:0:18726:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9d6feb453380) 00000020:00000080:1.0:1787380503.460286:0:18726:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1787380503.460437:0:18726:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6fff5a6800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787380503.460441:0:18726:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6fff5a6800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787380503.460443:0:18726:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6fff5a6800 3 00010000:00080000:1.0:1787380503.460468:0:18726:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ec10c1000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.130@tcp at head 00010000:00010000:1.0:1787380503.462074:0:18726:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1787380503.462176:0:18726:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1787380503.462215:0:18726:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787380503.462236:0:18726:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xcf3c46fdcad6a098 00000100:00080000:1.0:1787380503.462244:0:18726:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787380503.462250:0:18726:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9d6ec10c1000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:1.0:1787380503.462292:0:18726:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff4e30e00 x1874203867530752/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787380503.462333:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1874203867530752:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787380503.462390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380503.462444:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867530752 00000100:00100000:1.0:1787380503.462450:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867530752 00000100:00100000:1.0:1787380503.462476:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787380503.462483:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1874203867530752:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787380503.462506:0:17201:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 513 last 0 00000020:00000080:1.0:1787380503.462541:0:17201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xcf3c46fdcad6a09f 00000004:00100000:1.0:1787380503.462555:0:17201:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787380503.462582:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9d6ec10c7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380503.462627:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1874203867530752:12345-0@lo:38:llog_process_th.0 Request processed in 144us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380503.462635:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787380503.462668:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff4e30e00 x1874203867530752/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787380513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380503.462676:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787380503.462683:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1787380503.462688:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787380503.462692:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787380503.462694:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec10c1000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787380503.462700:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3638:1874203867530752:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787380503.462724:0:18726:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1787380503.462744:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787380503.462748:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787380503.462750:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787380503.462753:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787380503.462756:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787380503.462759:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787380503.462762:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787380503.462764:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1787380503.462964:0:18726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1787380503.467130:0:18700:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787380503.467175:0:18700:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787380503.467189:0:18700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c600/0xcf3c46fdcad6a06e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a075 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380503.467200:0:18700:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c600/0xcf3c46fdcad6a06e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a075 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787380503.467249:0:18700:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787380503.467251:0:18700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787380503.467252:0:18700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380503.467253:0:18700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380503.467254:0:18700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380503.467255:0:18700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380503.467257:0:18700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787380503.467258:0:18700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380503.467260:0:18700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787380503.467268:0:18700:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787380503.467270:0:18700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787380503.467271:0:18700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787380503.467272:0:18700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380503.467273:0:18700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380503.467274:0:18700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380503.467274:0:18700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380503.467275:0:18700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787380503.467277:0:18700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380503.467277:0:18700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787380503.467301:0:18700:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787380503.467320:0:18700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867530880:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787380503.467389:0:18700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380503.467423:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867530880 00000100:00100000:2.0:1787380503.467429:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867530880 00000100:00100000:2.0:1787380503.467470:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787380503.467479:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff63a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:18700:x1874203867530880:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787380503.467503:0:17194:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787380503.467517:0:17194:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787380503.467626:0:18700:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd24150c0 going to sleep for 11 seconds 20000000:01000000:2.0:1787380503.477665:0:17194:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787380503.477682:0:17194:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787380503.477837:0:17215:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787380503.477842:0:17215:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787380503.477862:0:17215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0a6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.477881:0:17215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ff0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69fe9 expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.477889:0:17215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ec3df1e00/0xcf3c46fdcad69ffe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad69ff7 expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.477979:0:17215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0a6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.478084:0:17215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ec3df1e00/0xcf3c46fdcad69ffe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad69ff7 expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.478116:0:17215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6ec3df1e00/0xcf3c46fdcad69ffe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad69ff7 expref: 21 pid: 17193 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380503.478130:0:17215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e30e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1874203867531008:0@lo:104: 00000100:00100000:1.0:1787380503.478199:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787380503.478244:0:17215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ff0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad69fe9 expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.478252:0:17215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ff0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad69fe9 expref: 21 pid: 17193 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380503.478261:0:17215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e31c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1874203867531136:0@lo:104: 00000100:00100000:1.0:1787380503.478284:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380503.478433:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff63a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:18700:x1874203867530880:12345-0@lo:253:mount.lustre.0 Request processed in 10955us (11042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380503.478444:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787380503.478506:0:18700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:18700:1874203867530880:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787380503.478516:0:18700:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787380503.478519:0:18700:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787380503.478521:0:18700:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787380503.478522:0:18700:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787380503.478524:0:18700:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787380503.478525:0:18700:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787380503.478532:0:18700:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787380503.478534:0:18700:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787380503.478535:0:18700:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787380503.478537:0:18700:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787380503.478550:0:18700:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1787380503.479318:0:17215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffb833600 going to sleep for 11 seconds 00000100:00100000:3.0:1787380503.479383:0:17182:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787380503.479398:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867531008 00000100:00100000:3.0:1787380503.479404:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867531008 00000100:00100000:3.0:1787380503.479430:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867531136 00000100:00100000:3.0:1787380503.479434:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867531136 00000100:00100000:3.0:1787380503.479447:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787380503.479454:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+4:17215:x1874203867531008:12345-0@lo:104: 00010000:00010000:3.0:1787380503.479466:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad69ffe expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380503.479576:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787380503.479583:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+4:17215:x1874203867531008:12345-0@lo:104: Request processed in 129us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380503.479590:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787380503.479605:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787380503.479611:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fcff73050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+3:17215:x1874203867531136:12345-0@lo:104: 00010000:00010000:3.0:1787380503.479618:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0200/0xcf3c46fdcad69fe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad69ff0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380503.479649:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787380503.479654:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fcff73050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+3:17215:x1874203867531136:12345-0@lo:104: Request processed in 45us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380503.479660:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1787380503.479824:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787380503.479830:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad69ffe expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.479838:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0f400 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:1.0:1787380503.479842:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ff7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad69ffe expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.479851:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad69ffe expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380503.479858:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ff7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad69ffe expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380503.479864:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787380503.479910:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ff7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69ffe expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.479917:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380503.479935:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ff7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69ffe expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.479941:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0f400/0xcf3c46fdcad69ff7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69ffe expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.479952:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380503.479955:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0200/0xcf3c46fdcad69fe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad69ff0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.479961:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df0200 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:1.0:1787380503.479964:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0200/0xcf3c46fdcad69fe9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad69ff0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.479970:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0200/0xcf3c46fdcad69fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad69ff0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380503.479977:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0200/0xcf3c46fdcad69fe9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad69ff0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380503.479982:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787380503.480005:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0200/0xcf3c46fdcad69fe9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69ff0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.480011:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380503.480024:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0200/0xcf3c46fdcad69fe9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69ff0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.480040:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0200/0xcf3c46fdcad69fe9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad69ff0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.480053:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380503.480054:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380503.480056:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380503.480068:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3640:1874203867531264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380503.480103:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380503.480135:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff4e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867531392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380503.480174:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380503.480206:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867531264 00000100:00100000:1.0:1787380503.480216:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867531264 00010000:00010000:1.0:1787380503.480235:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ec3df1e00/0xcf3c46fdcad69ffe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad69ff7 expref: 21 pid: 17193 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380503.480254:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867531392 00000100:00100000:1.0:1787380503.480257:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867531392 00010000:00010000:1.0:1787380503.480267:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ff0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad69fe9 expref: 22 pid: 17193 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380503.480279:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787380503.480285:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:3640:x1874203867531264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380503.480294:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380503.480299:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ec3df1e00/0xcf3c46fdcad69ffe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad69ff7 expref: 22 pid: 17193 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.480310:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ec3df1e00/0xcf3c46fdcad69ffe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad69ff7 expref: 22 pid: 17193 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.480330:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380503.480357:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:3640:x1874203867531264:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380503.480364:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787380503.480377:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787380503.480382:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef756c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:3641:x1874203867531392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380503.480390:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380503.480394:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ff0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad69fe9 expref: 21 pid: 17193 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.480404:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ff0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad69fe9 expref: 21 pid: 17193 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.480416:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0a6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380503.480423:0:17215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ec3df1e00/0xcf3c46fdcad69ffe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad69ff7 expref: 21 pid: 17193 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.480427:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0a6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380503.480445:0:17215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e30e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1874203867531008:0@lo:104: 20000000:01000000:1.0:1787380503.480450:0:17186:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008205876s 00010000:00010000:1.0:1787380503.480455:0:17186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0a6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380503.480460:0:17215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fd0d0ec00/0xcf3c46fdcad69ff0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad69fe9 expref: 20 pid: 17193 timeout: 613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.480466:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0a6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380503.480473:0:17215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e31c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1874203867531136:0@lo:104: 00010000:00010000:1.0:1787380503.480476:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0a6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.480501:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380503.480504:0:17215:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.480509:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1200 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380503.480516:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380503.480519:0:17215:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0a6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.480530:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0a6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380503.480532:0:17215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0a6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.480552:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0a6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380503.480560:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380503.480589:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef756c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+19:3641:x1874203867531392:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380503.480596:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787380503.480648:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3640:1874203867531264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380503.480668:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867531392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787380503.480799:0:17215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0a6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380503.481301:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787380503.489131:0:18700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787380503.494616:0:18700:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787380503.494625:0:18700:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787380503.494663:0:18700:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787380503.494705:0:18700:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.130@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787380503.494723:0:18700:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787380503.494751:0:18700:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787380503.502659:0:18700:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787380503.502896:0:18700:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787380504.205091:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867531520:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787380504.205169:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380504.205289:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867531648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787380504.205318:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380504.205360:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867531520 00000100:00100000:1.0:1787380504.205366:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867531520 00000100:00100000:1.0:1787380504.205406:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867531648 00000100:00100000:1.0:1787380504.205427:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867531648 00000100:00100000:1.0:1787380504.205447:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787380504.205454:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867531520:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787380504.205484:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787380504.205506:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787380504.205520:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867531648:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787380504.205528:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867531520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380504.205535:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787380504.205575:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867531520:0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787380504.205657:0:17939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787380504.205952:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867531648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 436us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380504.205959:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787380504.206696:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867531648:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1787380504.370279:0:18781:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787380504.370642:0:18781:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787380504.460463:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787380504.524955:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787380504.524961:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6ff3daa800 from 9 10000000:01000000:0.0:1787380504.524965:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787380504.525013:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866a00/0xcf3c46fdcad6a0ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.525025:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866a00/0xcf3c46fdcad6a0ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.525035:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866a00/0xcf3c46fdcad6a0ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380504.525057:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867531776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787380504.525116:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380504.525165:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc821b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380504.525170:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867531776 00000100:00100000:1.0:1787380504.525177:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867531776 00000100:00100000:1.0:1787380504.525233:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787380504.525242:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+19:17196:x1874203867531776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380504.525254:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380504.525266:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6a0ad expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380504.525287:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a0ad expref: 20 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380504.525297:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a0ad expref: 20 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380504.525305:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df1200, rc 0) 00000100:00100000:1.0:1787380504.525358:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+20:17196:x1874203867531776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380504.525366:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787380504.528414:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867531776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380504.528441:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866a00/0xcf3c46fdcad6a0ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a0b4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.528453:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866a00/0xcf3c46fdcad6a0ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad6a0b4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380504.528519:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867531904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787380504.528579:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380504.528618:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc821b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380504.529094:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867531904 00000100:00100000:1.0:1787380504.529101:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867531904 00000100:00100000:1.0:1787380504.529149:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787380504.529159:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+20:17196:x1874203867531904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787380504.529180:0:17194:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787380504.529195:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787380504.529198:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1787380504.529292:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+20:17196:x1874203867531904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380504.529299:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787380504.530309:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867531904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787380504.530377:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787380504.530386:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866a00/0xcf3c46fdcad6a0ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a0b4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.530397:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866a00/0xcf3c46fdcad6a0ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a0b4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380504.530407:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787380504.530410:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6ec3e05800 from 9 10000000:01000000:0.0:1787380504.530412:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787380504.530438:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866e00/0xcf3c46fdcad6a0bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.530447:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866e00/0xcf3c46fdcad6a0bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380504.530456:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866e00/0xcf3c46fdcad6a0bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380504.530481:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867532032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787380504.530519:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380504.530558:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc821b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380504.532327:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867532032 00000100:00100000:3.0:1787380504.532339:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867532032 00000100:00100000:3.0:1787380504.532541:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787380504.532551:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff63b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+20:17196:x1874203867532032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380504.532567:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380504.532581:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a0c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6a0bb expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380504.532603:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a0bb expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380504.532613:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a0bb expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380504.532630:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89ca00, rc 0) 00000100:00100000:3.0:1787380504.532687:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff63b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:17196:x1874203867532032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (2167us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380504.532694:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787380504.536877:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867532032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380504.536904:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866e00/0xcf3c46fdcad6a0bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a0c2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380504.536917:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866e00/0xcf3c46fdcad6a0bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad6a0c2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380504.536983:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867532160:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787380504.538163:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380504.538210:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fb9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787380504.538385:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867532160 00000100:00100000:0.0:1787380504.538392:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867532160 00000100:00100000:0.0:1787380504.538445:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787380504.538455:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:17196:x1874203867532160:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787380504.538477:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787380504.538494:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787380504.538497:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1787380504.538579:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:17196:x1874203867532160:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380504.538587:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787380504.538669:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867532160:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787380504.538731:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787380504.538740:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866e00/0xcf3c46fdcad6a0bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a0c2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380504.538751:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866e00/0xcf3c46fdcad6a0bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a0c2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380505.488318:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380506.516152:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787380506.892605:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787380507.532681:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380508.556846:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787380508.811995:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787380508.812002:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787380508.812004:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787380508.812007:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787380508.812137:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3640:1874203867532288:0@lo:400:kworker.0 00000100:00100000:0.0:1787380508.812211:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787380508.812386:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787380508.812390:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787380508.812393:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787380508.812396:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787380508.812429:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867532416:0@lo:400:kworker.0 00000100:00100000:1.0:1787380508.812472:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380508.812493:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867532928:0@lo:400:kworker.0 00000100:00100000:1.0:1787380508.812516:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380508.812533:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787380508.812538:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867532544:0@lo:400:kworker.0 00000100:00100000:1.0:1787380508.812556:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380508.812570:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1874203867533056:0@lo:400:kworker.0 00000100:00100000:1.0:1787380508.812585:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380508.812625:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867532416 00000100:00100000:1.0:1787380508.812632:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867532416 00000100:00100000:1.0:1787380508.812669:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787380508.812687:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867532416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380508.812734:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867532416:12345-0@lo:400:kworker.0 Request processed in 47us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380508.812741:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787380508.812762:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867532928 00000100:00100000:1.0:1787380508.812766:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867532928 00000100:00100000:1.0:1787380508.812789:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867532544 00000100:00100000:1.0:1787380508.812792:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867532544 00000100:00100000:1.0:1787380508.812802:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867533056 00000100:00100000:1.0:1787380508.812804:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867533056 00000100:00100000:1.0:1787380508.812840:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787380508.812845:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867532928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380508.812873:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867532928:12345-0@lo:400:kworker.0 Request processed in 27us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380508.812878:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787380508.812888:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787380508.812899:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867532544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380508.812923:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1874203867532544:12345-0@lo:400:kworker.0 Request processed in 24us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380508.812928:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787380508.812938:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787380508.812942:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874203867533056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380508.812960:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1874203867533056:12345-0@lo:400:kworker.0 Request processed in 19us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380508.812965:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787380508.812997:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec3f8f800 x1874203867532544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380508.813008:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3641:1874203867532544:0@lo:400:kworker.0 00000100:00100000:0.0:1787380508.813621:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867532672:0@lo:400:kworker.0 00000100:00100000:0.0:1787380508.813656:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380508.813682:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380508.813688:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867532800:0@lo:400:kworker.0 00000100:00100000:0.0:1787380508.813706:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380508.813729:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867532672 00000100:00100000:0.0:1787380508.813733:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867532672 00000100:00100000:0.0:1787380508.813761:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787380508.813767:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867532672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380508.813829:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867532672:12345-0@lo:400:kworker.0 Request processed in 61us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380508.813835:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787380508.813861:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867532672:0@lo:400:kworker.0 00000100:00100000:0.0:1787380508.813885:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867532800 00000100:00100000:0.0:1787380508.813888:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867532800 00000100:00100000:0.0:1787380508.813908:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787380508.813913:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867532800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380508.813941:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867532800:12345-0@lo:400:kworker.0 Request processed in 28us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380508.813946:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1787380508.813967:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec3d79c00 x1874203867532800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380508.813977:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867532800:0@lo:400:kworker.0 00000100:00100000:3.0:1787380508.814208:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867532288 00000100:00100000:3.0:1787380508.814213:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867532288 00000100:00100000:3.0:1787380508.814257:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787380508.814264:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff63a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:3640:x1874203867532288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380508.814311:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff63a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:3640:x1874203867532288:12345-0@lo:400:kworker.0 Request processed in 48us (2100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380508.814317:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1787380508.814353:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787380508.814357:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380508.814494:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3640:1874203867532288:0@lo:400:kworker.0 00010000:00080000:1.0:1787380508.814675:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec3d78700 x1874203867533056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380508.814685:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3641:1874203867533056:0@lo:400:kworker.0 00000100:00100000:1.0:1787380508.814695:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867532416:0@lo:400:kworker.0 00010000:00080000:1.0:1787380508.814704:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec3d7b800 x1874203867532928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380508.814711:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867532928:0@lo:400:kworker.0 00000100:00100000:1.0:1787380509.323963:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867533184:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787380509.324031:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380509.324138:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867533184 00000100:00100000:3.0:1787380509.324146:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867533184 00000100:00100000:0.0:1787380509.324164:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380509.324172:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867533312:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380509.324188:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787380509.324197:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867533184:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787380509.324197:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380509.324221:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867533312 00000100:00100000:0.0:1787380509.324225:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867533312 00000100:00100000:0.0:1787380509.324246:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787380509.324252:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867533312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787380509.324278:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000004:00000024:3.0:1787380509.324293:0:17939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787380509.324320:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867533184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380509.324320:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867533312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380509.324328:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787380509.325395:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787380509.325457:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867533312:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380509.325472:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867533184:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787380509.579881:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787380510.047836:0:19070:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1787380510.284346:0:17958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787380510.606462:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787380510.825197:0:19122:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787380510.825406:0:19122:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787380511.628119:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787380511.693561:0:19173:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787380511.694237:0:19173:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787380512.652016:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380513.675926:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380513.749005:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380498/real 1787380498] req@ffff9d6ff4e32300 x1874203867525760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380513 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380513.749032:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ff4e32300 x1874203867525760/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380513 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380513.749042:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380498/real 1787380498] req@ffff9d6ff4e30000 x1874203867525888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380513 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380513.749053:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ff4e30000 x1874203867525888/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380513 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787380513.749133:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ffb910000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787380513.749147:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787380513.749152:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867525760:0@lo:8:kworker.0 00000100:00080000:0.0:1787380513.749156:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6feb639800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787380513.749161:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787380513.749163:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff4e30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867525888:0@lo:8:kworker.0 00000100:00080000:2.0:1787380513.750932:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787380513.750938:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787380513.750941:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787380513.750944:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787380513.750977:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787380513.750980:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787380513.750984:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d6ffb910000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787380513.750990:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 508 00000100:00080000:2.0:1787380513.750994:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787380513.751000:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9d6ffb910000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:2.0:1787380513.751017:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3cb3b80 x1874203867533952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787380513.751043:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787380513.751046:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787380513.751048:0:37:0:(import.c:65:import_set_state_nolock()) ffff9d6feb639800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787380513.751051:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 508 00000100:00080000:2.0:1787380513.751053:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787380513.751056:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d6feb639800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:2.0:1787380513.751065:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3cb0700 x1874203867534080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787380513.752002:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867533696:0@lo:400:kworker.0 00000100:00100000:0.0:1787380513.752063:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380513.752127:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867534464:0@lo:400:kworker.0 00000100:00100000:0.0:1787380513.752152:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380513.752184:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380513.752191:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867533824:0@lo:400:kworker.0 00000100:00100000:0.0:1787380513.752215:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380513.752263:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867533696 00000100:00100000:0.0:1787380513.752270:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867533696 00000100:00100000:0.0:1787380513.752303:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867534464 00000100:00100000:0.0:1787380513.752306:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867534464 00000100:00100000:0.0:1787380513.752331:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787380513.752338:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867533696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380513.752383:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867533696:12345-0@lo:400:kworker.0 Request processed in 46us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380513.752390:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787380513.752406:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787380513.752411:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867534464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380513.752436:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1874203867534464:12345-0@lo:400:kworker.0 Request processed in 25us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380513.752442:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787380513.752477:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec3cb1c00 x1874203867533696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380513.752489:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867533696:0@lo:400:kworker.0 00010000:00080000:0.0:1787380513.752500:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec44aaa00 x1874203867534464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380513.752507:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3639:1874203867534464:0@lo:400:kworker.0 00000100:00100000:2.0:1787380513.752849:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867533440:0@lo:400:kworker.0 00000100:00100000:2.0:1787380513.752884:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380513.752908:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867534208:0@lo:400:kworker.0 00000100:00100000:2.0:1787380513.752927:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380513.752944:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787380513.752949:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867533568:0@lo:400:kworker.0 00000100:00100000:2.0:1787380513.752967:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380513.752980:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867534336:0@lo:400:kworker.0 00000100:00100000:2.0:1787380513.753056:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380513.753085:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867533952:0@lo:8:kworker.0 00000100:00100000:2.0:1787380513.753379:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380513.753398:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867534080:0@lo:8:kworker.0 00000100:00100000:2.0:1787380513.753417:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380513.753452:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867534208 00000100:00100000:2.0:1787380513.753457:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867534208 00000100:00100000:2.0:1787380513.753484:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867534336 00000100:00100000:2.0:1787380513.753493:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867534336 00000100:00100000:2.0:1787380513.753514:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787380513.753521:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867534208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380513.753555:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867534208:12345-0@lo:400:kworker.0 Request processed in 35us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380513.753561:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787380513.753573:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787380513.753578:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867534336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380513.753597:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867534336:12345-0@lo:400:kworker.0 Request processed in 19us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380513.753603:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787380513.753638:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec44a8380 x1874203867534336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380513.753643:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867533824 00000100:00100000:3.0:1787380513.753649:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867533824 00000100:00100000:2.0:1787380513.753653:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867534336:0@lo:400:kworker.0 00010000:00080000:2.0:1787380513.753666:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec3cb3100 x1874203867534208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380513.753675:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867534208:0@lo:400:kworker.0 00000100:00100000:3.0:1787380513.753691:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867533568 00000100:00100000:3.0:1787380513.753695:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867533568 00000100:00100000:3.0:1787380513.753710:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787380513.753716:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867533824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380513.753765:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867533824:12345-0@lo:400:kworker.0 Request processed in 48us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380513.753771:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787380513.753785:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787380513.753797:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867533568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380513.753896:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867533824:0@lo:400:kworker.0 00000100:00100000:3.0:1787380513.753986:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867533568:12345-0@lo:400:kworker.0 Request processed in 188us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380513.753992:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1787380513.754010:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787380513.754013:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787380513.754023:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867533440 00000100:00100000:3.0:1787380513.754027:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867533440 00000100:00100000:3.0:1787380513.754052:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787380513.754057:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff63b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:3641:x1874203867533440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380513.754099:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff63b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:3641:x1874203867533440:12345-0@lo:400:kworker.0 Request processed in 29us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380513.754105:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787380513.754224:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867533952 00000100:00100000:1.0:1787380513.754229:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867533952 00000100:00100000:1.0:1787380513.754256:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867534080 00000100:00100000:1.0:1787380513.754259:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867534080 00000100:00100000:1.0:1787380513.754269:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380513.754274:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1874203867533952:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787380513.754298:0:18706:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:1.0:1787380513.754327:0:18706:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3c46fdcad6a0c9 00002000:00100000:1.0:1787380513.754340:0:18706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9d6ec10c5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113674 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787380513.754344:0:18706:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1787380513.754346:0:18706:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787380513.754642:0:18706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1787380513.754806:0:18706:0:(import.c:65:import_set_state_nolock()) ffff9d6ec10c4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380513.755311:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1874203867533952:12345-0@lo:8:kworker.0 Request processed in 1034us (1929us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380513.755319:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787380513.755338:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787380513.755342:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1874203867534080:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787380513.755355:0:18706:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1787380513.755470:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ec3cb3b80 x1874203867533952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787380533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380513.755481:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787380513.755495:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1787380513.755503:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787380513.755507:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787380513.755510:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ffb910000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787380513.755528:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787380513.755534:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867533952:0@lo:8:kworker.0 00000004:00080000:0.0:1787380513.755560:0:17940:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787380513.755605:0:17941:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000004:00080000:0.0:1787380513.755621:0:17940:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 524079811488ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787380513.755623:0:17941:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17941:1874203867534720:0@lo:7:osp-pre-0-1.0 00080000:00080000:0.0:1787380513.755627:0:17940:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787380513.755654:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380513.755749:0:17941:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576480 going to sleep for 11 seconds 00000100:00100000:3.0:1787380513.755766:0:18704:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787380513.755773:0:18704:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787380513.756622:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867533568:0@lo:400:kworker.0 00000100:00100000:2.0:1787380513.756634:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867533440:0@lo:400:kworker.0 00000100:00100000:2.0:1787380513.756657:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867534592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787380513.756699:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380513.756856:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867534592 00000100:00100000:2.0:1787380513.756866:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867534592 00000100:00100000:2.0:1787380513.757035:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380513.757044:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1874203867534592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787380513.757069:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787380513.757119:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3640:x1874203867534592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380513.757126:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787380513.757145:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787380513.757163:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3fc0e00 x1874203867534592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380513.757178:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867534592:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1787380513.757382:0:17931:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1787380513.757780:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867534720 00000100:00100000:0.0:1787380513.757786:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867534720 00000100:00100000:2.0:1787380513.758390:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787380513.758399:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17941:x1874203867534720:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:2.0:1787380513.768771:0:19267:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1787380513.768779:0:19267:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1787380513.768988:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17941:x1874203867534720:12345-0@lo:7:osp-pre-0-1.0 Request processed in 10587us (13329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380513.768999:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787380513.769110:0:17941:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3fc0a80 x1874203867534720/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787380529 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380513.769125:0:17941:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17941:1874203867534720:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1787380513.769138:0:17941:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787380513.769175:0:17941:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17941:1874203867534848:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787380513.769291:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380513.769316:0:17941:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576480 going to sleep for 11 seconds 00000100:00100000:3.0:1787380513.769340:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867534848 00000100:00100000:3.0:1787380513.769346:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867534848 00000100:00100000:3.0:1787380513.769390:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787380513.769399:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17941:x1874203867534848:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787380513.769422:0:18704:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1787380513.769456:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17941:x1874203867534848:12345-0@lo:5:osp-pre-0-1.0 Request processed in 59us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380513.769464:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787380513.769607:0:17941:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3fc0a80 x1874203867534848/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787380529 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380513.769618:0:17941:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17941:1874203867534848:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1787380513.769627:0:17941:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1787380513.769652:0:17941:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17941:1874203867534976:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1787380513.769804:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380513.770603:0:17941:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576480 going to sleep for 11 seconds 00000100:00100000:0.0:1787380513.771100:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867534976 00000100:00100000:0.0:1787380513.771107:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867534976 00000100:00100000:0.0:1787380513.771153:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787380513.771161:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17941:x1874203867534976:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787380513.771265:0:19267:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1787380513.786598:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1874203867534080:12345-0@lo:8:kworker.0 Request processed in 31246us (33170us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787380513.786611:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787380513.787527:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6feb639800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787380513.787534:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787380513.787539:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867534080:0@lo:8:kworker.0 00000001:00080000:0.0:1787380513.816631:0:18701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1787380513.816643:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787380513.818937:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17941:x1874203867534976:12345-0@lo:5:osp-pre-0-1.0 Request processed in 47768us (49125us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787380513.818949:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787380513.819035:0:17941:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3fc0a80 x1874203867534976/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787380529 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380513.819046:0:17941:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787380513.819052:0:17941:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17941:1874203867534976:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787380513.819067:0:17941:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1787380513.819134:0:17941:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17941:1874203867535104:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787380513.819169:0:17941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380513.819202:0:17941:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc39ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380513.820069:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867535104 00000100:00100000:2.0:1787380513.820077:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867535104 00000100:00100000:2.0:1787380513.820246:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787380513.820256:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17941:x1874203867535104:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787380513.820326:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17941:x1874203867535104:12345-0@lo:900:osp-pre-0-1.0 Request processed in 71us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380513.820339:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787380513.820564:0:17941:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc43eb100 x1874203867535104/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787380529 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380513.820577:0:17941:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17941:1874203867535104:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787380514.446616:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380514.446648:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867535232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380514.446710:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380514.447194:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867535232 00000100:00100000:3.0:1787380514.447200:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867535232 00000100:00100000:3.0:1787380514.447243:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787380514.447253:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867535232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787380514.447283:0:17939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787380514.447328:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867535232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380514.447335:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787380514.447714:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787380514.447728:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867535360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787380514.447762:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380514.447897:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867535232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380514.448165:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867535360 00000100:00100000:3.0:1787380514.448171:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867535360 00000100:00100000:3.0:1787380514.448201:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787380514.448209:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867535360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787380514.448238:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787380514.448284:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867535360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380514.448290:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787380514.448440:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867535360:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787380514.701020:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380515.727287:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787380516.108473:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787380516.748993:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380517.772001:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787380517.881556:0:19518:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787380517.881564:0:19518:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787380517.881566:0:19518:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787380517.881744:0:19518:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9d6ec10c4800 00000020:01000004:1.0:1787380517.881759:0:19518:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787380517.881773:0:19518:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787380517.881787:0:19518:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9d6feb454d40) 00000020:00000080:1.0:1787380517.881804:0:19518:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787380517.932294:0:19518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787380517.933262:0:19518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787380517.933531:0:19518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787380517.935233:0:19518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787380517.935529:0:19518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1787380517.935939:0:19518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787380517.936183:0:19518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1787380517.941013:0:19518:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787380517.941213:0:19518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787380517.941225:0:19518:0:(osd_handler.c:8929:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787380517.941235:0:19518:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf3c46fdcad6a0d7 00000020:01000004:0.0:1787380517.941240:0:19518:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787380517.941259:0:19518:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.130@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787380517.941262:0:19518:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.130@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787380517.941267:0:19518:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787380517.941289:0:19518:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1787380517.941293:0:19518:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.130@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1787380517.952087:0:19518:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.130@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787380517.952123:0:19518:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.130@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1787380517.952127:0:19518:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787380517.952128:0:19518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787380517.952130:0:19518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380517.952131:0:19518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380517.952132:0:19518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380517.952133:0:19518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380517.952135:0:19518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787380517.952136:0:19518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380517.952137:0:19518:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787380517.952141:0:19518:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1787380517.952143:0:19518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787380517.952144:0:19518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787380517.952145:0:19518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380517.952146:0:19518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380517.952148:0:19518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380517.952149:0:19518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380517.952150:0:19518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787380517.952151:0:19518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380517.952152:0:19518:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787380517.952177:0:19518:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787380517.952194:0:19518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867535488:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787380517.952253:0:19518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380517.952299:0:19518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fe0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787380517.952463:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867535488 00000100:00100000:0.0:1787380517.952487:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867535488 00000100:00100000:0.0:1787380517.952535:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787380517.952544:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:19518:x1874203867535488:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787380517.952571:0:17192:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787380517.952574:0:17192:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787380517.952580:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787380517.953087:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:19518:x1874203867535488:12345-0@lo:253:mount.lustre.0 Request processed in 542us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380517.953095:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787380517.953167:0:19518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867535488:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787380517.953177:0:19518:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787380517.953179:0:19518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787380517.953188:0:19518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787380517.953189:0:19518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787380517.953191:0:19518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787380517.953192:0:19518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787380517.953193:0:19518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787380517.953195:0:19518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787380517.953196:0:19518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787380517.953198:0:19518:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787380517.953215:0:19518:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9d6ec10c4800 from lustre-OST0001 10000000:01000000:1.0:1787380517.953238:0:19518:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787380517.953242:0:19518:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787380517.953249:0:19518:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9d6ec34f3380 local copy 00010000:00010000:1.0:1787380517.953259:0:19518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69df1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69df8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380517.953338:0:19518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867535616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380517.953367:0:19518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380517.953569:0:19518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fe0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380517.953605:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867535616 00000100:00100000:3.0:1787380517.953610:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867535616 00000100:00100000:3.0:1787380517.953680:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787380517.953689:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:19518:x1874203867535616:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787380517.953793:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:19518:x1874203867535616:12345-0@lo:501:mount.lustre.0 Request processed in 105us (424us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787380517.953800:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787380517.954078:0:19518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867535616:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787380517.954091:0:19518:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.130@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787380517.954109:0:19518:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.130@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787380517.954115:0:19518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69df1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69df8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380517.954124:0:19518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0fe00/0xcf3c46fdcad69df1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad69df8 expref: -99 pid: 17178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380517.954148:0:19518:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9d6ec10c4800 10000000:01000000:1.0:1787380517.954153:0:19518:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787380517.954158:0:19518:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787380517.954161:0:19518:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787380517.954173:0:19518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787380517.954176:0:19518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787380517.954197:0:19518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad6a0de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380517.954205:0:19518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad6a0de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380517.954214:0:19518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad6a0de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380517.954227:0:19518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867535744:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787380517.954253:0:19518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380517.954284:0:19518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fe0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787380517.954332:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867535744 00000100:00100000:0.0:1787380517.954336:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867535744 00000100:00100000:0.0:1787380517.954370:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787380517.954386:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:19518:x1874203867535744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787380517.954395:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380517.954405:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7867e00/0xcf3c46fdcad6a0e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6a0de expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380517.954425:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7867e00/0xcf3c46fdcad6a0e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a0de expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380517.954434:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7867e00/0xcf3c46fdcad6a0e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a0de expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380517.954442:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867e00, rc 0) 00000100:00100000:0.0:1787380517.954488:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:19518:x1874203867535744:12345-0@lo:101:mount.lustre.0 Request processed in 111us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380517.954495:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787380517.954573:0:19518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d78700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867535744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787380517.954586:0:19518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad6a0de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a0e5 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380517.954595:0:19518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad6a0de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad6a0e5 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787380517.955990:0:19518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787380517.956615:0:19518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787380517.958371:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787380517.958584:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787380517.958599:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787380517.958611:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787380517.958624:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787380517.958637:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787380517.958661:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787380517.958667:0:19518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787380517.958759:0:19518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867535872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380517.958989:0:19518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380517.959077:0:19518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787380517.959118:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867535872 00000100:00100000:0.0:1787380517.959126:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867535872 00000100:00100000:0.0:1787380517.959210:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787380517.959219:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:19518:x1874203867535872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380517.959361:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:19518:x1874203867535872:12345-0@lo:501:mount.lustre.0 Request processed in 142us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380517.959368:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787380517.959446:0:19518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867535872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787380517.959499:0:19518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867536000:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787380517.959536:0:19518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380517.959712:0:19518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787380517.959780:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867536000 00000100:00100000:1.0:1787380517.959785:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867536000 00000100:00100000:1.0:1787380517.959841:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787380517.959849:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:19518:x1874203867536000:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787380517.961983:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:19518:x1874203867536000:12345-0@lo:503:mount.lustre.0 Request processed in 2129us (2440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380517.961996:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787380517.962132:0:19518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867536000:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787380517.962627:0:19518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787380517.962700:0:19518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867536128:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380517.962747:0:19518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380517.962772:0:19518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576480 going to sleep for 11 seconds 00000100:00100000:0.0:1787380517.962941:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867536128 00000100:00100000:0.0:1787380517.962946:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867536128 00000100:00100000:0.0:1787380517.962986:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787380517.962994:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:19518:x1874203867536128:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787380517.963446:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:19518:x1874203867536128:12345-0@lo:502:mount.lustre.0 Request processed in 453us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380517.963454:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787380517.963618:0:19518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867536128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787380517.963779:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787380517.963806:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787380517.963928:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787380517.963944:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787380517.963959:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787380517.963973:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787380517.963987:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787380517.963999:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787380517.964012:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787380517.964039:0:19518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867536256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787380517.964091:0:19518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380517.964216:0:19518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc8576480 going to sleep for 11 seconds 00000100:00100000:3.0:1787380517.964272:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867536256 00000100:00100000:3.0:1787380517.964278:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867536256 00000100:00100000:1.0:1787380517.964372:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787380517.964438:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:19518:x1874203867536256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787380517.964583:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:19518:x1874203867536256:12345-0@lo:502:mount.lustre.0 Request processed in 146us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380517.964589:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787380517.964666:0:19518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44aad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867536256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787380517.964709:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787380517.964717:0:19518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1787380517.965335:0:19522:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787380517.965342:0:19522:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1787380517.965347:0:19522:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787380517.965349:0:19522:0:(obd_config.c:1561:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787380517.965354:0:19522:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787380517.965366:0:19522:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9d6ff5f63380) 00000020:00000080:0.0:1787380517.965395:0:19522:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787380517.965400:0:19522:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787380517.965561:0:19522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6ec10c4800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787380517.965571:0:19522:0:(osd_handler.c:8929:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787380517.965577:0:19522:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcf3c46fdcad6a0f3 00010000:00010000:1.0:1787380517.970125:0:19522:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1787380517.970510:0:19522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1787380517.972554:0:19522:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1787380517.973790:0:19522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787380517.974306:0:19522:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380517.974314:0:19522:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380517.974316:0:19522:0:(obd_config.c:1561:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787380517.974322:0:19522:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787380517.974326:0:19522:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380517.974334:0:19522:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787380517.974338:0:19522:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787380517.974340:0:19522:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787380517.974343:0:19522:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380517.974345:0:19522:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380517.974347:0:19522:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787380517.974349:0:19522:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787380517.974352:0:19522:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380517.974353:0:19522:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787380517.974356:0:19522:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787380517.974448:0:19522:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787380517.974453:0:19522:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787380517.974454:0:19522:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787380517.974458:0:19522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787380517.974584:0:19518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787380517.974619:0:19518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787380517.974640:0:19518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad6a0de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a0e5 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380517.974653:0:19518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df0600/0xcf3c46fdcad6a0de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a0e5 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380517.974667:0:19518:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ec10c4800 from 1 10000000:01000000:3.0:1787380517.974670:0:19518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787380517.974705:0:19518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad6a0fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380517.974713:0:19518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad6a0fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380517.974723:0:19518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad6a0fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380517.974745:0:19518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867536384:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787380517.974805:0:19518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380517.974861:0:19518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb45d240 going to sleep for 11 seconds 00000100:00100000:1.0:1787380517.976523:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867536384 00000100:00100000:1.0:1787380517.976535:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867536384 00000100:00100000:1.0:1787380517.976592:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787380517.976602:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:19518:x1874203867536384:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380517.976616:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380517.976694:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ec3df0800/0xcf3c46fdcad6a101 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6a0fa expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380517.976777:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ec3df0800/0xcf3c46fdcad6a101 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a0fa expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380517.976789:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ec3df0800/0xcf3c46fdcad6a101 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a0fa expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380517.976799:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df0800, rc 0) 00000100:00100000:1.0:1787380517.977139:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:19518:x1874203867536384:12345-0@lo:101:mount.lustre.0 Request processed in 538us (2332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380517.977147:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787380517.977293:0:19518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867536384:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787380517.977310:0:19518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad6a0fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a101 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380517.977320:0:19518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad6a0fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad6a101 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787380517.978791:0:19518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787380517.979313:0:19518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787380517.979535:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787380517.979560:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787380517.979577:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787380517.979583:0:19518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787380517.979646:0:19518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867536512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380517.979706:0:19518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380517.980018:0:19518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787380517.980132:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867536512 00000100:00100000:1.0:1787380517.980139:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867536512 00000100:00100000:1.0:1787380517.980186:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787380517.980268:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:19518:x1874203867536512:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380517.980423:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:19518:x1874203867536512:12345-0@lo:501:mount.lustre.0 Request processed in 229us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380517.980431:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787380517.982004:0:19518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867536512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380517.982053:0:19518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867536640:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787380517.982124:0:19518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380517.982164:0:19518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380517.982218:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867536640 00000100:00100000:3.0:1787380517.982224:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867536640 00000100:00100000:3.0:1787380517.982269:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787380517.982278:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:19518:x1874203867536640:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787380517.982376:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:19518:x1874203867536640:12345-0@lo:503:mount.lustre.0 Request processed in 99us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380517.982384:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787380517.982460:0:19518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867536640:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787380517.982840:0:19518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787380517.982901:0:19518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867536768:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787380517.982937:0:19518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380517.982957:0:19518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380517.983086:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867536768 00000100:00100000:3.0:1787380517.983090:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867536768 00000100:00100000:3.0:1787380517.983122:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787380517.983129:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:19518:x1874203867536768:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787380517.983206:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:19518:x1874203867536768:12345-0@lo:502:mount.lustre.0 Request processed in 77us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380517.983222:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787380517.983260:0:19518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867536768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787380517.983420:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787380517.983441:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787380517.983453:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787380517.983478:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787380517.983490:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787380517.983500:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787380517.983511:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787380517.983522:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1787380517.983534:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787380517.983545:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1787380517.983556:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1787380517.983575:0:19518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867536896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787380517.983608:0:19518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380517.983627:0:19518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb45db40 going to sleep for 11 seconds 00000100:00100000:0.0:1787380517.984612:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867536896 00000100:00100000:0.0:1787380517.984619:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867536896 00000100:00100000:0.0:1787380517.984660:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787380517.984668:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:19518:x1874203867536896:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787380517.985215:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:19518:x1874203867536896:12345-0@lo:502:mount.lustre.0 Request processed in 547us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380517.985223:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787380517.985618:0:19518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867536896:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787380517.985693:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1787380517.985781:0:19518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787380517.987363:0:19526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380517.987387:0:19526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380517.987389:0:19526:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787380517.987397:0:19526:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6ec10c4800 00000020:00000080:3.0:1787380517.987400:0:19526:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787380517.987408:0:19526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380517.987410:0:19526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380517.987411:0:19526:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787380517.987414:0:19526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380517.987416:0:19526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380517.987417:0:19526:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787380517.987420:0:19526:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9d6ec10c4800 00000020:00000080:3.0:1787380517.987422:0:19526:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787380517.987514:0:19526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380517.987524:0:19526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380517.987525:0:19526:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787380517.987528:0:19526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380517.987530:0:19526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380517.987531:0:19526:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787380517.987535:0:19526:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6ec10c4800 00000020:00000080:3.0:1787380517.987536:0:19526:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787380517.989227:0:19526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380517.989237:0:19526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380517.989239:0:19526:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787380517.989243:0:19526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787380517.989246:0:19526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380517.989247:0:19526:0:(obd_config.c:1561:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787380517.989251:0:19526:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9d6ec10c4800 00000020:00000080:3.0:1787380517.989254:0:19526:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787380517.989305:0:19526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787380517.989309:0:19526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787380517.989311:0:19526:0:(obd_config.c:1561:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787380517.989315:0:19526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1787380517.989519:0:19518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787380517.989548:0:19518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787380517.989596:0:19518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad6a0fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a101 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380517.989618:0:19518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad6a0fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a101 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380517.989669:0:19518:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787380517.989672:0:19518:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9d6ec10c4800 10000000:01000000:1.0:1787380517.989676:0:19518:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9d6ec10c4800 10000000:01000000:1.0:1787380517.989684:0:19518:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787380517.989689:0:19518:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9d6ec10c4800 from 1 10000000:01000000:1.0:1787380517.989692:0:19518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787380517.989726:0:19518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1800/0xcf3c46fdcad6a108 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380517.989735:0:19518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1800/0xcf3c46fdcad6a108 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380517.989745:0:19518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1800/0xcf3c46fdcad6a108 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380517.989769:0:19518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867537024:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787380517.990352:0:19518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380517.990442:0:19518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3fe0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787380517.990581:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867537024 00000100:00100000:0.0:1787380517.990589:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867537024 00000100:00100000:0.0:1787380517.991277:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787380517.991288:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:19518:x1874203867537024:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787380517.991302:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380517.991317:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe7866000/0xcf3c46fdcad6a10f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6a108 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380517.991342:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7866000/0xcf3c46fdcad6a10f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a108 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380517.991352:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe7866000/0xcf3c46fdcad6a10f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a108 expref: 24 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380517.991360:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866000, rc 0) 00000100:00100000:0.0:1787380517.994359:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:19518:x1874203867537024:12345-0@lo:101:mount.lustre.0 Request processed in 3065us (4000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380517.994372:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787380517.995419:0:19518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867537024:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787380517.995443:0:19518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1800/0xcf3c46fdcad6a108 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a10f expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380517.995467:0:19518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1800/0xcf3c46fdcad6a108 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad6a10f expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787380518.000034:0:19518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1787380518.000380:0:19518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787380518.000550:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787380518.000575:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787380518.000595:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787380518.000611:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787380518.000641:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787380518.000657:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787380518.000669:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787380518.000695:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787380518.000710:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787380518.001313:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787380518.001339:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787380518.001358:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787380518.001372:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787380518.001391:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787380518.001404:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787380518.001422:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787380518.001440:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787380518.001460:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787380518.001478:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787380518.001494:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787380518.001528:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787380518.001549:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787380518.001565:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787380518.001584:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787380518.001604:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1787380518.001621:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1787380518.001657:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1787380518.001675:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1787380518.001691:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1787380518.001708:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1787380518.002184:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1787380518.002958:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1787380518.002984:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1787380518.003001:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1787380518.003019:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1787380518.003034:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1787380518.003060:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1787380518.003094:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1787380518.003109:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1787380518.003123:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1787380518.003136:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1787380518.003150:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1787380518.003161:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1787380518.003175:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1787380518.003188:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1787380518.003964:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1787380518.003999:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1787380518.004005:0:19518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1787380518.004107:0:19518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867537152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380518.004164:0:19518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380518.004272:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867537152 00000100:00100000:0.0:1787380518.004279:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867537152 00000100:00100000:0.0:1787380518.004332:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787380518.004341:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:19518:x1874203867537152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787380518.004451:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:19518:x1874203867537152:12345-0@lo:501:mount.lustre.0 Request processed in 111us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380518.004458:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787380518.004801:0:19518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fe00ff180 going to sleep for 11 seconds 00000100:00100000:1.0:1787380518.004856:0:19518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867537152:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787380518.004956:0:19518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867537280:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787380518.005006:0:19518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380518.005033:0:19518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fe00ff180 going to sleep for 11 seconds 00000100:00100000:0.0:1787380518.005154:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867537280 00000100:00100000:0.0:1787380518.005159:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867537280 00000100:00100000:0.0:1787380518.005205:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787380518.005212:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:19518:x1874203867537280:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787380518.005293:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:19518:x1874203867537280:12345-0@lo:503:mount.lustre.0 Request processed in 81us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380518.005300:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787380518.005463:0:19518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867537280:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787380518.007584:0:19518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787380518.007671:0:19518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867537408:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787380518.007753:0:19518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380518.007803:0:19518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787380518.007864:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867537408 00000100:00100000:0.0:1787380518.007872:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867537408 00000100:00100000:0.0:1787380518.007913:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787380518.007921:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:19518:x1874203867537408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787380518.008114:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:19518:x1874203867537408:12345-0@lo:502:mount.lustre.0 Request processed in 193us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380518.008122:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787380518.009313:0:19518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867537408:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787380518.009526:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787380518.009555:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787380518.009570:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787380518.009598:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787380518.009615:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787380518.009628:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787380518.009640:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787380518.009652:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787380518.009665:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787380518.009678:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787380518.009689:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787380518.009699:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787380518.010980:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787380518.011023:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787380518.011038:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787380518.011050:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787380518.011063:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787380518.011091:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787380518.011103:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787380518.011133:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787380518.011148:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787380518.011161:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787380518.011174:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787380518.011187:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787380518.011957:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1787380518.011987:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1787380518.012001:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1787380518.012014:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1787380518.012025:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1787380518.012037:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1787380518.012052:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1787380518.012076:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1787380518.012094:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1787380518.012111:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1787380518.012125:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1787380518.012156:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1787380518.012174:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1787380518.012189:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1787380518.012565:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1787380518.012582:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1787380518.012597:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1787380518.012612:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1787380518.012626:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1787380518.012641:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1787380518.012655:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1787380518.012671:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1787380518.012843:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1787380518.012865:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1787380518.014400:0:19518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867537536:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787380518.014470:0:19518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380518.014513:0:19518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1787380518.014540:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867537536 00000100:00100000:1.0:1787380518.014546:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867537536 00000100:00100000:1.0:1787380518.014597:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787380518.014605:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:19518:x1874203867537536:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787380518.016328:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:19518:x1874203867537536:12345-0@lo:502:mount.lustre.0 Request processed in 1718us (1852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380518.016346:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787380518.016352:0:19518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d7bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867537536:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787380518.016565:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1787380518.016597:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1787380518.016630:0:19518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867537664:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787380518.016691:0:19518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380518.016728:0:19518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb62f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380518.017336:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867537664 00000100:00100000:1.0:1787380518.017344:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867537664 00000100:00100000:1.0:1787380518.017383:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787380518.017391:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:19518:x1874203867537664:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787380518.017497:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:19518:x1874203867537664:12345-0@lo:502:mount.lustre.0 Request processed in 106us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380518.017504:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787380518.017802:0:19518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867537664:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787380518.017870:0:19518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1787380518.017880:0:19518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787380518.019804:0:19531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787380518.020742:0:19531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9d6ff5f60000) 00000020:00000080:0.0:1787380518.020765:0:19531:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1787380518.020956:0:19531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6ec10c4800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787380518.020971:0:19531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6ec10c4800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787380518.020974:0:19531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6ec10c4800 3 00010000:00080000:0.0:1787380518.021005:0:19531:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ec2056800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.130@tcp at head 00010000:00010000:0.0:1787380518.025437:0:19531:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1787380518.025528:0:19531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787380518.025573:0:19531:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787380518.025586:0:19531:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcf3c46fdcad6a11d 00000100:00080000:0.0:1787380518.025597:0:19531:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787380518.025603:0:19531:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9d6ec2056800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1787380518.025634:0:19531:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6fc43e9180 x1874203867537792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787380518.026475:0:19531:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787380518.026617:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867537920:0@lo:400:kworker.0 00000100:00100000:0.0:1787380518.026695:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787380518.026826:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787380518.026831:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787380518.026834:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787380518.026837:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787380518.026887:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787380518.026894:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867538048:0@lo:400:kworker.0 00000100:00100000:0.0:1787380518.026922:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380518.026985:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1874203867537792:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787380518.027022:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:0.0:1787380518.027287:0:19531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787380518.027311:0:19531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9d6ec379b380) 00000020:00000080:0.0:1787380518.027332:0:19531:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1787380518.027477:0:19531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9d6ec10c4800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787380518.027481:0:19531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9d6ec10c4800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787380518.027483:0:19531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9d6ec10c4800 3 00010000:00080000:0.0:1787380518.027506:0:19531:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9d6ec2055800@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.130@tcp at head 00000100:00100000:1.0:1787380518.028326:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867538176:0@lo:400:kworker.0 00000100:00100000:1.0:1787380518.028371:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787380518.030099:0:19531:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1787380518.030191:0:19531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1787380518.030234:0:19531:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787380518.030245:0:19531:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xcf3c46fdcad6a12b 00000100:00080000:0.0:1787380518.030253:0:19531:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787380518.030259:0:19531:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9d6ec2055800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1787380518.030285:0:19531:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6fc43eaa00 x1874203867538432/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787380518.031309:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867538048 00000100:00100000:2.0:1787380518.031320:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867538048 00000100:00100000:2.0:1787380518.031361:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867537792 00000100:00100000:2.0:1787380518.031364:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867537792 00000100:00100000:2.0:1787380518.031379:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787380518.031388:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867538048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380518.031765:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867538048:12345-0@lo:400:kworker.0 Request processed in 321us (4785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380518.031774:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787380518.031792:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787380518.031797:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3638:x1874203867537792:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787380518.031839:0:17199:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:2.0:1787380518.032002:0:17199:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcf3c46fdcad6a132 00000004:00100000:2.0:1787380518.032017:0:17199:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787380518.032044:0:17199:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2748000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787380518.032091:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1874203867537792:12345-0@lo:38:llog_process_th.0 Request processed in 292us (5068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380518.032104:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787380518.034310:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787380518.034328:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867538304:0@lo:400:kworker.0 00000100:00100000:1.0:1787380518.034386:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380518.034449:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1874203867538432:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787380518.034497:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787380518.034541:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc43e9180 x1874203867537792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787380528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380518.034551:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787380518.034560:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787380518.034567:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787380518.034573:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787380518.034576:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2056800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787380518.034583:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3638:1874203867537792:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787380518.034832:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787380518.034837:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787380518.034840:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d6feb639800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787380518.034845:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 524 00000100:00080000:3.0:1787380518.034850:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787380518.034855:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d6feb639800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:3.0:1787380518.034889:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ff3fc0e00 x1874203867538560/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787380518.034948:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867537920 00000100:00100000:3.0:1787380518.034954:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867537920 00000100:00100000:3.0:1787380518.035002:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867538176 00000100:00100000:3.0:1787380518.035005:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867538176 00000100:00100000:3.0:1787380518.035020:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787380518.035027:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867537920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380518.035089:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867537920:12345-0@lo:400:kworker.0 Request processed in 62us (8394us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380518.035096:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787380518.035112:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787380518.035118:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867538176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380518.035148:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867538176:12345-0@lo:400:kworker.0 Request processed in 30us (6777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380518.035154:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787380518.035171:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787380518.035197:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867538944:0@lo:400:kworker.0 00000100:00100000:3.0:1787380518.035226:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380518.035483:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867538432 00000100:00100000:2.0:1787380518.035489:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867538432 00000100:00100000:2.0:1787380518.035503:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867538944 00000100:00100000:2.0:1787380518.035505:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867538944 00000100:00100000:2.0:1787380518.035534:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787380518.035542:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867538944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380518.035586:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867538944:12345-0@lo:400:kworker.0 Request processed in 45us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380518.035593:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787380518.035608:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787380518.035612:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1874203867538432:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787380518.035633:0:17201:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:2.0:1787380518.035663:0:17201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xcf3c46fdcad6a139 00000004:00100000:2.0:1787380518.035677:0:17201:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787380518.035700:0:17201:0:(import.c:65:import_set_state_nolock()) ffff9d6ec274f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787380518.036931:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1874203867538432:12345-0@lo:38:llog_process_th.0 Request processed in 1251us (2366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380518.036943:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787380518.036982:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867538688:0@lo:400:kworker.0 00000100:00100000:2.0:1787380518.037015:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787380518.037055:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3fc2a00 x1874203867538048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380518.037077:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867538048:0@lo:400:kworker.0 00000100:00100000:2.0:1787380518.037092:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867537920:0@lo:400:kworker.0 00000100:00100000:2.0:1787380518.037118:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380518.037125:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867538816:0@lo:400:kworker.0 00000100:00100000:2.0:1787380518.037148:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380518.037176:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867538304 00000100:00100000:2.0:1787380518.037181:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867538304 00000100:00100000:2.0:1787380518.037996:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787380518.038006:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867538304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380518.038056:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867538304:12345-0@lo:400:kworker.0 Request processed in 51us (3669us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380518.038062:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787380518.038098:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787380518.038102:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1787380518.038132:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3fc0700 x1874203867538944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380518.038144:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867538944:0@lo:400:kworker.0 00000100:00100000:2.0:1787380518.038164:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867538688 00000100:00100000:2.0:1787380518.038168:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867538688 00000100:00100000:2.0:1787380518.038183:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867538816 00000100:00100000:2.0:1787380518.038186:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867538816 00000100:00100000:2.0:1787380518.038369:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787380518.038378:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867538688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380518.038415:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867538688:12345-0@lo:400:kworker.0 Request processed in 39us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380518.038422:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787380518.038433:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787380518.038440:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867538816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380518.038478:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867538816:12345-0@lo:400:kworker.0 Request processed in 38us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380518.038485:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1787380518.038502:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787380518.038519:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3fc3800 x1874203867538816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380518.038529:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867538816:0@lo:400:kworker.0 00010000:00080000:2.0:1787380518.038539:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3fc1c00 x1874203867538688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380518.038546:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867538688:0@lo:400:kworker.0 00000100:00080000:0.0:1787380518.039749:0:19531:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787380518.039834:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787380518.039839:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787380518.039842:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787380518.039845:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787380518.040087:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867538560:0@lo:8:kworker.0 00000100:00100000:0.0:1787380518.040146:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380518.040283:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867538560 00000100:00100000:2.0:1787380518.040290:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867538560 00000100:00100000:2.0:1787380518.040320:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787380518.040327:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1874203867538560:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787380518.040380:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3638:x1874203867538560:12345-0@lo:8:kworker.0 Request processed in 52us (233us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787380518.040386:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787380518.041168:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787380518.041177:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6feb639800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787380518.041240:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787380518.041246:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867538560:0@lo:8:kworker.0 00010000:00080000:0.0:1787380518.041282:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6fc43eaa00 x1874203867538432/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787380528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380518.041291:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787380518.041297:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1787380518.041305:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787380518.041310:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1787380518.041312:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2055800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787380518.041319:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3638:1874203867538432:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787380518.041367:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9d6ff3fc0a80 x1874203867538304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787380534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000040:00080000:1.0:1787380518.042028:0:19531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:0.0:1787380518.043542:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867538304:0@lo:400:kworker.0 00000100:00100000:0.0:1787380518.043577:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867538176:0@lo:400:kworker.0 00000020:01000000:0.0:1787380518.043617:0:19518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1787380518.043721:0:19518:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787380518.043743:0:19518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1800/0xcf3c46fdcad6a108 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a10f expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380518.043767:0:19518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ec3df1800/0xcf3c46fdcad6a108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a10f expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787380518.043834:0:19518:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787380518.043836:0:19518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787380518.043837:0:19518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787380518.043839:0:19518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787380518.043840:0:19518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787380518.043841:0:19518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787380518.043842:0:19518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787380518.043844:0:19518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787380518.043845:0:19518:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787380518.043849:0:19518:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787380518.043851:0:19518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787380518.043852:0:19518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787380518.043853:0:19518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787380518.043854:0:19518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787380518.043855:0:19518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787380518.043856:0:19518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787380518.043857:0:19518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787380518.043858:0:19518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787380518.043860:0:19518:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787380518.043879:0:19518:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787380518.043894:0:19518:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867539072:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787380518.043952:0:19518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380518.044400:0:19518:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc52c0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380518.047977:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867539072 00000100:00100000:1.0:1787380518.047991:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867539072 00000100:00100000:0.0:1787380518.048107:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787380518.048116:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:19518:x1874203867539072:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787380518.048146:0:17192:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787380518.048158:0:17192:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787380518.056357:0:17192:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787380518.056380:0:17192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787380518.057612:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:19518:x1874203867539072:12345-0@lo:253:mount.lustre.0 Request processed in 9194us (13356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380518.057638:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787380518.057757:0:19518:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7d8d387d-7e15-4118-9d7b-f7697dc8c103:19518:1874203867539072:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787380518.057770:0:19518:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787380518.057783:0:19518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787380518.057933:0:19518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787380518.057935:0:19518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787380518.057936:0:19518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787380518.057937:0:19518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787380518.057939:0:19518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787380518.057940:0:19518:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787380518.057942:0:19518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787380518.057943:0:19518:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787380518.057958:0:19518:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1787380518.061280:0:17215:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787380518.061289:0:17215:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787380518.061312:0:17215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6fe7866c00/0xcf3c46fdcad6a140 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380518.061337:0:17215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a0ad expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380518.061344:0:17215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a0c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a0bb expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380518.061351:0:17215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6fe7866c00/0xcf3c46fdcad6a140 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380518.062176:0:17215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad6a0bb expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380518.062194:0:17215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a0c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a0bb expref: 23 pid: 17193 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380518.062208:0:17215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1874203867539200:0@lo:104: 00000100:00100000:0.0:1787380518.062268:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787380518.062326:0:17215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad6a0ad expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380518.062335:0:17215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a0ad expref: 23 pid: 17192 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380518.062345:0:17215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1874203867539328:0@lo:104: 00000100:00100000:0.0:1787380518.062368:0:17215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380518.062389:0:17215:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb62f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380518.062842:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867539200 00000100:00100000:1.0:1787380518.062850:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867539200 00000100:00100000:1.0:1787380518.062950:0:17183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867539328 00000100:00100000:1.0:1787380518.062954:0:17183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867539328 00000100:00100000:1.0:1787380518.062970:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787380518.062978:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+4:17215:x1874203867539200:12345-0@lo:104: 00010000:00010000:1.0:1787380518.062990:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866e00/0xcf3c46fdcad6a0bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad6a0c2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.063051:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787380518.063057:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+4:17215:x1874203867539200:12345-0@lo:104: Request processed in 80us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380518.063074:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787380518.063091:0:17183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787380518.063097:0:17183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+3:17215:x1874203867539328:12345-0@lo:104: 00010000:00010000:1.0:1787380518.063104:0:17183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866a00/0xcf3c46fdcad6a0ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad6a0b4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380518.063130:0:17215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1874203867539200:0@lo:104: 00010000:00010000:1.0:1787380518.063140:0:17183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787380518.063145:0:17215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17215:1874203867539328:0@lo:104: 00000100:00100000:1.0:1787380518.063148:0:17183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+3:17215:x1874203867539328:12345-0@lo:104: Request processed in 50us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380518.063156:0:17183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787380518.063179:0:17215:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6fe7866c00/0xcf3c46fdcad6a140 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.063184:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787380518.063791:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866e00/0xcf3c46fdcad6a0bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad6a0c2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.063848:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866e00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:1.0:1787380518.063853:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866e00/0xcf3c46fdcad6a0bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad6a0c2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.063861:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866e00/0xcf3c46fdcad6a0bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad6a0c2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380518.064264:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866e00/0xcf3c46fdcad6a0bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad6a0c2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380518.064272:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787380518.064314:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866e00/0xcf3c46fdcad6a0bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad6a0c2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.064320:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380518.064343:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866e00/0xcf3c46fdcad6a0bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad6a0c2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.064350:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866e00/0xcf3c46fdcad6a0bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad6a0c2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.064364:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380518.064367:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866a00/0xcf3c46fdcad6a0ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad6a0b4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.064372:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866a00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:1.0:1787380518.064375:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866a00/0xcf3c46fdcad6a0ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad6a0b4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.064393:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866a00/0xcf3c46fdcad6a0ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad6a0b4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787380518.064398:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866a00/0xcf3c46fdcad6a0ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad6a0b4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787380518.064403:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787380518.064416:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866a00/0xcf3c46fdcad6a0ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad6a0b4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.064421:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787380518.064952:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866a00/0xcf3c46fdcad6a0ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad6a0b4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.064961:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866a00/0xcf3c46fdcad6a0ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad6a0b4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.064975:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380518.064977:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380518.064979:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380518.065004:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3642:1874203867539456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380518.065004:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3639:1874203867539584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380518.065115:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380518.065304:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380518.065351:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867539584 00000100:00100000:1.0:1787380518.065358:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867539584 00010000:00010000:1.0:1787380518.065379:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a0ad expref: 24 pid: 17192 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380518.065401:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867539456 00000100:00100000:1.0:1787380518.065404:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867539456 00010000:00010000:1.0:1787380518.065424:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a0c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a0bb expref: 25 pid: 17193 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380518.065439:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787380518.065446:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+25:3639:x1874203867539584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380518.065458:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787380518.065464:0:17185:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1787380518.065465:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a0ad expref: 25 pid: 17192 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380518.065475:0:17185:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1787380518.065480:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a0ad expref: 25 pid: 17192 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.065496:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ec3df1200/0xcf3c46fdcad6a0b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad6a0ad expref: 25 pid: 17192 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.065509:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380518.065549:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:3639:x1874203867539584:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380518.065556:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787380518.065573:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787380518.065580:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3639:1874203867539584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380518.065581:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:3642:x1874203867539456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380518.065595:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380518.065600:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a0c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a0bb expref: 23 pid: 17193 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.065611:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a0c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a0bb expref: 23 pid: 17193 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.065621:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a0c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad6a0bb expref: 23 pid: 17193 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.065641:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6fe7866c00/0xcf3c46fdcad6a140 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.065649:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe7866c00/0xcf3c46fdcad6a140 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787380518.065661:0:17184:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008205876s 00010000:00010000:1.0:1787380518.065666:0:17184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fe7866c00/0xcf3c46fdcad6a140 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.065672:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6fe7866c00/0xcf3c46fdcad6a140 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.065678:0:17184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6fe7866c00/0xcf3c46fdcad6a140 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.065689:0:17184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6fe7866c00/0xcf3c46fdcad6a140 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.065695:0:17184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866c00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380518.065699:0:17184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6fe7866c00/0xcf3c46fdcad6a140 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.065706:0:17184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6fe7866c00/0xcf3c46fdcad6a140 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.066294:0:17184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6fe7866c00/0xcf3c46fdcad6a140 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380518.066306:0:17215:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6fe7866c00/0xcf3c46fdcad6a140 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380518.066308:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787380518.066318:0:17215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6fe7866c00/0xcf3c46fdcad6a140 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380518.066326:0:17215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7866c00/0xcf3c46fdcad6a140 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380518.066356:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:3642:x1874203867539456:12345-0@lo:103:ldlm_bl.0 Request processed in 775us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380518.066362:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787380518.066471:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3642:1874203867539456:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787380518.067595:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787380518.071722:0:19518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787380518.082343:0:19518:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787380518.082353:0:19518:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787380518.082596:0:19518:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787380518.082642:0:19518:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.130@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787380518.082660:0:19518:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787380518.082686:0:19518:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787380518.088221:0:19518:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787380518.088754:0:19518:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787380518.798520:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787380518.957947:0:19587:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787380518.958605:0:19587:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787380519.054637:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867539712:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787380519.054705:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380519.055099:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867539712 00000100:00100000:1.0:1787380519.055107:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867539712 00000100:00100000:1.0:1787380519.055158:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787380519.055168:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867539712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787380519.055196:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787380519.055354:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867539712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 188us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380519.055362:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787380519.055430:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3d78000 x1874203867539712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380519.055448:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867539712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787380519.056304:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380499/real 1787380499] req@ffff9d6ec3cb2300 x1874203867527296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380519 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380519.056326:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ec3cb2300 x1874203867527296/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380519 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380519.056336:0:3638:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787380499/real 1787380499] req@ffff9d6ec3cb2680 x1874203867527424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380519 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380519.056347:0:3638:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9d6ec3cb2680 x1874203867527424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787380519 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787380519.056363:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6fd1713000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787380519.056386:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787380519.056390:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867527296:0@lo:8:kworker.0 00000100:00080000:1.0:1787380519.056395:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec231e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787380519.056412:0:3638:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787380519.056415:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867527424:0@lo:8:kworker.0 00000100:00080000:0.0:1787380519.056520:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380519.056525:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787380519.056528:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d6fd1713000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787380519.056532:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 509 00000100:00080000:0.0:1787380519.056537:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787380519.056543:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9d6fd1713000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1787380519.056561:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3cb0e00 x1874203867540096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787380519.056572:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380519.056581:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787380519.056583:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d6ec231e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787380519.056586:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 509 00000100:00080000:0.0:1787380519.056589:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787380519.056592:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9d6ec231e000 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1787380519.056603:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3cb3100 x1874203867540224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787380519.056631:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787380519.056634:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787380519.056636:0:8:0:(import.c:65:import_set_state_nolock()) ffff9d6feb639800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787380519.056640:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9d6feb639800 using connection 192.168.206.130@tcp/0@lo 00000100:00100000:0.0:1787380519.056647:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9d6ec3cb2300 x1874203867540608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787380519.056687:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867540480:0@lo:400:kworker.0 00000100:00100000:0.0:1787380519.056738:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380519.056766:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1874203867541120:0@lo:400:kworker.0 00000100:00100000:0.0:1787380519.056796:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380519.056841:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787380519.056848:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867540352:0@lo:400:kworker.0 00000100:00100000:2.0:1787380519.056971:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867539968:0@lo:400:kworker.0 00000100:00100000:2.0:1787380519.056999:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380519.057019:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1874203867540864:0@lo:400:kworker.0 00000100:00100000:2.0:1787380519.057038:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380519.057054:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787380519.057070:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3642:1874203867539840:0@lo:400:kworker.0 00000100:00100000:2.0:1787380519.057101:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380519.057126:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867540736:0@lo:400:kworker.0 00000100:00100000:2.0:1787380519.057144:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380519.057158:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867541248:0@lo:400:kworker.0 00000100:00100000:2.0:1787380519.057183:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380519.057219:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867541120 00000100:00100000:2.0:1787380519.057226:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867541120 00000100:00100000:2.0:1787380519.057264:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867540864 00000100:00100000:2.0:1787380519.057267:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867540864 00000100:00100000:2.0:1787380519.057279:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867540736 00000100:00100000:2.0:1787380519.057282:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867540736 00000100:00100000:2.0:1787380519.057292:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867541248 00000100:00100000:2.0:1787380519.057295:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867541248 00000100:00100000:2.0:1787380519.057310:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787380519.057318:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874203867541120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380519.057360:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874203867541120:12345-0@lo:400:kworker.0 Request processed in 43us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380519.057366:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787380519.057390:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787380519.057396:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874203867540864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380519.057430:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874203867540864:12345-0@lo:400:kworker.0 Request processed in 34us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380519.057436:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787380519.057448:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787380519.057454:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867540736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380519.057495:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867540736:12345-0@lo:400:kworker.0 Request processed in 40us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380519.057501:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787380519.057514:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787380519.057519:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867541248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380519.057544:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867541248:12345-0@lo:400:kworker.0 Request processed in 25us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380519.057549:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1787380519.057570:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787380519.057573:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787380519.057670:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc43eb100 x1874203867540736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380519.057681:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc43eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867540736:0@lo:400:kworker.0 00010000:00080000:2.0:1787380519.057690:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3f8c000 x1874203867541248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380519.057697:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867541248:0@lo:400:kworker.0 00010000:00080000:2.0:1787380519.057704:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3f8c380 x1874203867540864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380519.057724:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1874203867540864:0@lo:400:kworker.0 00000100:00100000:0.0:1787380519.057975:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380519.058035:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867540992:0@lo:400:kworker.0 00000100:00100000:0.0:1787380519.058057:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380519.058176:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867540480 00000100:00100000:3.0:1787380519.058181:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867540480 00000100:00100000:3.0:1787380519.058223:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867539968 00000100:00100000:3.0:1787380519.058227:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867539968 00000100:00100000:3.0:1787380519.058243:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787380519.058249:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867540480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380519.058287:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867540480:12345-0@lo:400:kworker.0 Request processed in 38us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380519.058293:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787380519.058306:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787380519.058312:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867539968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380519.058343:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867539968:12345-0@lo:400:kworker.0 Request processed in 31us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380519.058349:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787380519.059113:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867539840 00000100:00100000:1.0:1787380519.059121:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867539840 00000100:00100000:1.0:1787380519.059155:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787380519.059162:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:3642:x1874203867539840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380519.059216:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:3642:x1874203867539840:12345-0@lo:400:kworker.0 Request processed in 54us (2112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380519.059222:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787380519.059257:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867540096:0@lo:8:kworker.0 00000100:00100000:1.0:1787380519.059290:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380519.059322:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867540224:0@lo:8:kworker.0 00000100:00100000:1.0:1787380519.059346:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380519.059362:0:3638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867540608:0@lo:8:kworker.0 00000100:00100000:1.0:1787380519.059382:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380519.059410:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867540096 00000100:00100000:1.0:1787380519.059414:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867540096 00000100:00100000:1.0:1787380519.059433:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867540224 00000100:00100000:1.0:1787380519.059435:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867540224 00000100:00100000:1.0:1787380519.059445:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867540608 00000100:00100000:1.0:1787380519.059447:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867540608 00000100:00100000:1.0:1787380519.059456:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787380519.059461:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1874203867540096:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787380519.059483:0:18707:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:1.0:1787380519.059510:0:18707:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3c46fdcad6a147 00002000:00100000:1.0:1787380519.059523:0:18707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9d6ec3f4d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113674 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787380519.059534:0:18707:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787380519.059537:0:18707:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787380519.059610:0:18707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787380519.059637:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3f4c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380519.059675:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1874203867540096:12345-0@lo:8:kworker.0 Request processed in 212us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380519.059682:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787380519.059695:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787380519.059699:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1874203867540224:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787380519.059714:0:18707:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:1.0:1787380519.059730:0:18707:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcf3c46fdcad6a14e 00002000:00100000:1.0:1787380519.059736:0:18707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9d6ec3f4e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113674 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787380519.059739:0:18707:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787380519.059741:0:18707:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787380519.060081:0:18707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787380519.060096:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3f4e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380519.060129:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1874203867540224:12345-0@lo:8:kworker.0 Request processed in 427us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380519.060136:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787380519.060151:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787380519.060155:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3638:x1874203867540608:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787380519.060171:0:18707:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:1.0:1787380519.060188:0:18707:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcf3c46fdcad6a155 00002000:00100000:1.0:1787380519.060205:0:18707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9d6ec3f4d000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113674 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1787380519.060209:0:18707:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1787380519.060218:0:18707:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787380519.060242:0:18707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1787380519.060255:0:18707:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3f49800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380519.060284:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3638:x1874203867540608:12345-0@lo:8:kworker.0 Request processed in 128us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380519.060291:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787380519.060336:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3cb0e00 x1874203867540096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787380544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380519.060346:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787380519.060353:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787380519.060361:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787380519.060366:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787380519.060368:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6fd1713000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787380519.060386:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787380519.060391:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867540096:0@lo:8:kworker.0 00010000:00080000:1.0:1787380519.060404:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3cb3100 x1874203867540224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787380544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380519.060410:0:3638:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787380519.060414:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787380519.060418:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787380519.060421:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787380519.060423:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6ec231e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787380519.060437:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787380519.060440:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3638:1874203867540224:0@lo:8:kworker.0 00010000:00080000:1.0:1787380519.060451:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3cb2300 x1874203867540608/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787380544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787380519.060472:0:3638:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1787380519.060477:0:3638:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787380519.060480:0:3638:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787380519.060482:0:3638:0:(import.c:65:import_set_state_nolock()) ffff9d6feb639800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787380519.060494:0:3638:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787380519.060498:0:3638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3638:1874203867540608:0@lo:8:kworker.0 00000004:00080000:1.0:1787380519.060553:0:17224:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1787380519.060571:0:17224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d79f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17224:1874203867541504:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787380519.060598:0:17224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380519.060614:0:17224:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041a000 going to sleep for 11 seconds 00000100:00100000:1.0:1787380519.060626:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787380519.060633:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867541376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380519.060656:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380519.060682:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867541376 00000100:00100000:1.0:1787380519.060687:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867541376 00000100:00100000:1.0:1787380519.060719:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787380519.060726:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874203867541376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787380519.060738:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787380519.060765:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3641:x1874203867541376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380519.060771:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787380519.060784:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787380519.060799:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3d78000 x1874203867541376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380519.060993:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867541376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380519.061019:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867541504 00000100:00100000:1.0:1787380519.061022:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867541504 00000100:00100000:1.0:1787380519.061041:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787380519.061046:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17224:x1874203867541504:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787380519.062077:0:17223:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787380519.062144:0:17223:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 529386334141ns, next at 0ns, rc = 0 00080000:00080000:1.0:1787380519.062150:0:17223:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00002000:00080000:1.0:1787380519.064334:0:18707:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1787380519.064345:0:18707:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1787380519.064351:0:18707:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:3.0:1787380519.066743:0:17225:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787380519.066855:0:17225:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 529391045101ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787380519.066861:0:17225:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1787380519.066878:0:17942:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787380519.066916:0:17942:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 529391106658ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787380519.066920:0:17942:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787380519.067185:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3642:1874203867539840:0@lo:400:kworker.0 00000100:00100000:3.0:1787380519.067447:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867539968:0@lo:400:kworker.0 00000100:00100000:0.0:1787380519.071050:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867540480:0@lo:400:kworker.0 00010000:00080000:0.0:1787380519.071081:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3f8e680 x1874203867541120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380519.071105:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1874203867541120:0@lo:400:kworker.0 00000100:00100000:2.0:1787380519.071191:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867540352 00000100:00100000:2.0:1787380519.071262:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867540352 00000100:00100000:2.0:1787380519.071309:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867540992 00000100:00100000:2.0:1787380519.071312:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867540992 00000100:00100000:2.0:1787380519.071330:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787380519.071338:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867540352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380519.071415:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867540352:12345-0@lo:400:kworker.0 Request processed in 77us (13439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380519.071422:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787380519.071439:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787380519.071445:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867540992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380519.071474:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867540992:12345-0@lo:400:kworker.0 Request processed in 29us (13416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380519.071480:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:2.0:1787380519.071530:0:17226:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1787380519.071554:0:17226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44a9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17226:1874203867541760:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787380519.071586:0:17226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380519.071611:0:17226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e83480 going to sleep for 11 seconds 00000004:00080000:2.0:1787380519.071635:0:17943:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787380519.071648:0:17943:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17943:1874203867542016:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787380519.071669:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380519.071683:0:17943:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff3e830c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787380519.071696:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867541760 00000100:00100000:2.0:1787380519.071699:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867541760 00000100:00100000:2.0:1787380519.071736:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867542016 00000100:00100000:2.0:1787380519.071739:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867542016 00000100:00100000:2.0:1787380519.071752:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787380519.071757:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17226:x1874203867541760:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787380519.073122:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867541888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380519.073172:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787380519.073286:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3cb1c00 x1874203867540352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380519.073298:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867540352:0@lo:400:kworker.0 00010000:00080000:0.0:1787380519.073312:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3f8f800 x1874203867540992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380519.073320:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867540992:0@lo:400:kworker.0 00000100:00100000:0.0:1787380519.073340:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380519.073347:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867541632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380519.073370:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380519.073404:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867541888 00000100:00100000:0.0:1787380519.073409:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867541888 00000100:00100000:0.0:1787380519.073436:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867541632 00000100:00100000:0.0:1787380519.073439:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867541632 00000100:00100000:0.0:1787380519.073452:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787380519.073460:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1874203867541888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787380519.073479:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:0.0:1787380519.073516:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3640:x1874203867541888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380519.073522:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787380519.073536:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787380519.073542:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff4e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1874203867541632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787380519.073562:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923533824 avail 3692011520 00000100:00100000:0.0:1787380519.073587:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff4e30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1874203867541632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380519.073593:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787380519.073622:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec44a9c00 x1874203867541632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380519.073636:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867541632:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787380519.073646:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec44aaa00 x1874203867541888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787380535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380519.073657:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867541888:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787380519.074343:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1787380519.080360:0:17931:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1787380519.084041:0:17179:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1787380519.084071:0:17179:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787380519.086650:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.086662:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b84c052e/0xcf3c46fdcad6a15c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.086678:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.086682:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.086688:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b84c052e/0xcf3c46fdcad6a15c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.086706:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b84c052e/0xcf3c46fdcad6a15c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.086717:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b84c052e/0xcf3c46fdcad6a15c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.086725:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b84c052e/0xcf3c46fdcad6a15c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.086750:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787380519.087002:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380519.087009:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b84c052e/0xcf3c46fdcad6a15c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.087018:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0e200 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380519.087023:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b84c052e/0xcf3c46fdcad6a15c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.087032:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b84c052e/0xcf3c46fdcad6a15c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.087052:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b84c052e/0xcf3c46fdcad6a15c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.087069:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b84c052e/0xcf3c46fdcad6a15c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.087102:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.087103:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.087105:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787380519.088070:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.088085:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c94a9f81/0xcf3c46fdcad6a163 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.088097:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.088101:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.088106:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c94a9f81/0xcf3c46fdcad6a163 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.088117:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c94a9f81/0xcf3c46fdcad6a163 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.088126:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c94a9f81/0xcf3c46fdcad6a163 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.088151:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c94a9f81/0xcf3c46fdcad6a163 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.088169:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787380519.088319:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380519.088325:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c94a9f81/0xcf3c46fdcad6a163 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.088333:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0ea00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380519.088337:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c94a9f81/0xcf3c46fdcad6a163 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.088345:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c94a9f81/0xcf3c46fdcad6a163 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.088359:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c94a9f81/0xcf3c46fdcad6a163 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.088366:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c94a9f81/0xcf3c46fdcad6a163 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.088379:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.088381:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.088382:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787380519.089546:0:19267:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1787380519.089555:0:19267:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1787380519.089560:0:19267:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00010000:3.0:1787380519.095428:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787380519.095443:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a16a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.095471:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1787380519.095476:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380519.095482:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a16a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.095498:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a16a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.095506:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a16a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.095513:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a16a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.095534:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787380519.095552:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380519.095558:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a16a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.095567:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d400 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:3.0:1787380519.095571:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a16a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.095580:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a16a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.095597:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a16a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.095603:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a16a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.095621:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380519.095623:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380519.095624:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787380519.101391:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.101407:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad6a171 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.101425:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.101430:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.101436:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad6a171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.102293:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad6a171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.102318:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad6a171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.102326:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad6a171 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.102347:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787380519.102360:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380519.102365:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad6a171 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.102373:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0ee00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380519.102377:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad6a171 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.102386:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad6a171 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.102403:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad6a171 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.102411:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f33a519/0xcf3c46fdcad6a171 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.102431:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.102439:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.102441:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787380519.103652:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.103663:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad6a178 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.103675:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.103679:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.103685:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad6a178 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.103697:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad6a178 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.103706:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad6a178 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.103713:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad6a178 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.103730:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787380519.103739:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380519.103743:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad6a178 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.103750:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0e400 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380519.103754:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad6a178 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.103775:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad6a178 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.103788:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad6a178 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.103793:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bfb53a2/0xcf3c46fdcad6a178 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.105298:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.105306:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.105309:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787380519.106629:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.106640:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000524490ff/0xcf3c46fdcad6a17f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.106655:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.106659:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.106663:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000524490ff/0xcf3c46fdcad6a17f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.106676:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000524490ff/0xcf3c46fdcad6a17f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.106683:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000524490ff/0xcf3c46fdcad6a17f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.106696:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000524490ff/0xcf3c46fdcad6a17f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.106712:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787380519.106723:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380519.106727:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000524490ff/0xcf3c46fdcad6a17f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.106734:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0f800 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380519.106738:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000524490ff/0xcf3c46fdcad6a17f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.106746:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000524490ff/0xcf3c46fdcad6a17f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.106761:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000524490ff/0xcf3c46fdcad6a17f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.106769:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000524490ff/0xcf3c46fdcad6a17f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.106787:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.106789:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.106790:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787380519.110511:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.110534:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad6a186 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.110551:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.110557:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.110562:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad6a186 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.110576:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad6a186 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.110586:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad6a186 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.110595:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad6a186 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.110613:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787380519.110624:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380519.110629:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad6a186 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.110637:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0fc00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380519.110642:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad6a186 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.110650:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad6a186 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.110671:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad6a186 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.110678:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008e6c0d6/0xcf3c46fdcad6a186 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.110693:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.110695:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.110697:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787380519.112068:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.112079:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b255468/0xcf3c46fdcad6a18d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.112091:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.112095:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.112101:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b255468/0xcf3c46fdcad6a18d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.112111:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b255468/0xcf3c46fdcad6a18d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.112120:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b255468/0xcf3c46fdcad6a18d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.112127:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b255468/0xcf3c46fdcad6a18d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.112154:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787380519.112164:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380519.112168:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b255468/0xcf3c46fdcad6a18d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.112175:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0ec00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380519.112179:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b255468/0xcf3c46fdcad6a18d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.112188:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b255468/0xcf3c46fdcad6a18d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.112606:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b255468/0xcf3c46fdcad6a18d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.112615:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b255468/0xcf3c46fdcad6a18d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.112633:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.112634:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.112636:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787380519.113652:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.113661:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041c0b3a9/0xcf3c46fdcad6a194 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.113673:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.113683:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.113687:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041c0b3a9/0xcf3c46fdcad6a194 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.113698:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041c0b3a9/0xcf3c46fdcad6a194 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.113707:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041c0b3a9/0xcf3c46fdcad6a194 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.113715:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041c0b3a9/0xcf3c46fdcad6a194 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.113733:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787380519.113742:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380519.113746:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041c0b3a9/0xcf3c46fdcad6a194 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.113753:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0f400 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380519.113757:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041c0b3a9/0xcf3c46fdcad6a194 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.113765:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041c0b3a9/0xcf3c46fdcad6a194 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.113778:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041c0b3a9/0xcf3c46fdcad6a194 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.113798:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041c0b3a9/0xcf3c46fdcad6a194 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.113842:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.113844:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.113846:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380519.114674:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.114683:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a19b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.114695:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.114698:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.114703:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a19b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.114716:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a19b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.114736:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a19b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.114743:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a19b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.114758:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787380519.114767:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380519.114771:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a19b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.114778:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866600 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.114783:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a19b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.114791:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a19b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.114803:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a19b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.115492:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a19b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.115511:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.115518:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.115520:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787380519.116075:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.116084:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdb6afe7/0xcf3c46fdcad6a1a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.116094:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.116097:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.116102:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdb6afe7/0xcf3c46fdcad6a1a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.116113:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdb6afe7/0xcf3c46fdcad6a1a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.116121:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdb6afe7/0xcf3c46fdcad6a1a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.116128:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdb6afe7/0xcf3c46fdcad6a1a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.116147:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787380519.116316:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380519.116322:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdb6afe7/0xcf3c46fdcad6a1a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.116330:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9be00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.116334:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdb6afe7/0xcf3c46fdcad6a1a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.116342:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdb6afe7/0xcf3c46fdcad6a1a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.116359:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdb6afe7/0xcf3c46fdcad6a1a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.116367:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdb6afe7/0xcf3c46fdcad6a1a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.116383:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.116385:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.116387:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380519.116427:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.116433:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a1a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.116441:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.116444:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.116467:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a1a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.116477:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a1a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.116486:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a1a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.116493:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a1a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.116506:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787380519.116514:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380519.116518:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a1a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.116524:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866c00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.116528:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a1a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.116536:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a1a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.116546:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a1a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.116564:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a1a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.116576:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.116578:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.116580:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380519.117359:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.117367:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a1b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.117377:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.117380:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.117385:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a1b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.117395:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a1b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.117403:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a1b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.117409:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a1b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.117423:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787380519.117431:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380519.117442:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a1b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787380519.117745:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.117756:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d67a4aeb/0xcf3c46fdcad6a1b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.117765:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.117768:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.117772:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d67a4aeb/0xcf3c46fdcad6a1b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.117781:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d67a4aeb/0xcf3c46fdcad6a1b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.117789:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d67a4aeb/0xcf3c46fdcad6a1b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.117795:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d67a4aeb/0xcf3c46fdcad6a1b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.117836:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787380519.117953:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866a00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.117958:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a1b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.117967:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a1b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.117980:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a1b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.117988:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a1b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.118004:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380519.118008:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d67a4aeb/0xcf3c46fdcad6a1b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.118015:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9ac00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.118018:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d67a4aeb/0xcf3c46fdcad6a1b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.118025:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d67a4aeb/0xcf3c46fdcad6a1b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.118048:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d67a4aeb/0xcf3c46fdcad6a1b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.118054:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d67a4aeb/0xcf3c46fdcad6a1b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.118080:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.118082:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.118084:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.118090:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787380519.118680:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.118687:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1169cf6/0xcf3c46fdcad6a1be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.118696:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.118699:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.118703:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1169cf6/0xcf3c46fdcad6a1be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.118714:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1169cf6/0xcf3c46fdcad6a1be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.118728:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1169cf6/0xcf3c46fdcad6a1be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.118734:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1169cf6/0xcf3c46fdcad6a1be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.118792:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787380519.119192:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.119210:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5d3b5dc/0xcf3c46fdcad6a1c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.119219:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.119223:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.119227:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5d3b5dc/0xcf3c46fdcad6a1c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.119236:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5d3b5dc/0xcf3c46fdcad6a1c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.119243:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5d3b5dc/0xcf3c46fdcad6a1c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.119249:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5d3b5dc/0xcf3c46fdcad6a1c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.119275:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787380519.119678:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.119685:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a117727/0xcf3c46fdcad6a1cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.119694:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.119697:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.119701:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a117727/0xcf3c46fdcad6a1cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.119710:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a117727/0xcf3c46fdcad6a1cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.119719:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a117727/0xcf3c46fdcad6a1cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.119726:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a117727/0xcf3c46fdcad6a1cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.119734:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787380519.120125:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.120133:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ac691c6/0xcf3c46fdcad6a1d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.120141:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.120149:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.120153:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ac691c6/0xcf3c46fdcad6a1d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.120163:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ac691c6/0xcf3c46fdcad6a1d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.120172:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ac691c6/0xcf3c46fdcad6a1d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.120178:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ac691c6/0xcf3c46fdcad6a1d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.120186:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1787380519.120565:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.120571:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a1da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.120578:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.120580:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.120584:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a1da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.120592:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a1da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.120599:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a1da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.120612:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a1da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.120620:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1787380519.121033:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.121039:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a1e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.121048:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.121051:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.121055:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a1e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.121077:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a1e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.121085:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a1e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.121092:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a1e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.121101:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1787380519.121410:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787380519.121417:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1169cf6/0xcf3c46fdcad6a1be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121426:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9a400 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.121431:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1169cf6/0xcf3c46fdcad6a1be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121439:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1169cf6/0xcf3c46fdcad6a1be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121528:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1169cf6/0xcf3c46fdcad6a1be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121537:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1169cf6/0xcf3c46fdcad6a1be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121568:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787380519.121572:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5d3b5dc/0xcf3c46fdcad6a1c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121580:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9ae00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.121583:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5d3b5dc/0xcf3c46fdcad6a1c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121590:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5d3b5dc/0xcf3c46fdcad6a1c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121601:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5d3b5dc/0xcf3c46fdcad6a1c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121608:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5d3b5dc/0xcf3c46fdcad6a1c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121619:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787380519.121623:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a117727/0xcf3c46fdcad6a1cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121629:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9b800 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.121633:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a117727/0xcf3c46fdcad6a1cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121653:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a117727/0xcf3c46fdcad6a1cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121664:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a117727/0xcf3c46fdcad6a1cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121671:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a117727/0xcf3c46fdcad6a1cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121686:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787380519.121690:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ac691c6/0xcf3c46fdcad6a1d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121696:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9a800 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.121699:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ac691c6/0xcf3c46fdcad6a1d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121706:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ac691c6/0xcf3c46fdcad6a1d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121717:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ac691c6/0xcf3c46fdcad6a1d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121723:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ac691c6/0xcf3c46fdcad6a1d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121749:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787380519.121753:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a1da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121759:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9b400 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.121762:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a1da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121769:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a1da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121778:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a1da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121784:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a1da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121795:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380519.121798:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a1e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.121803:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9a600 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.121806:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a1e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787380519.122005:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.122012:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a1e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.122027:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.122030:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.122034:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a1e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.122044:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a1e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.122053:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a1e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.122072:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a1e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.122082:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787380519.122428:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a1e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.122441:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a1e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787380519.122597:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.122604:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a1ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.122612:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.122615:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.122618:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a1ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.122627:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a1ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.122645:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a1ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.122652:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a1ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.122661:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787380519.122778:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a1e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.122797:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787380519.122800:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a1e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.122839:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9ba00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.122844:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a1e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.122852:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a1e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.123026:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a1e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.123035:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a1e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.123070:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380519.123074:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a1ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.123080:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9a000 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.123083:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a1ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.123091:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a1ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.123101:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a1ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.123107:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a1ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.123120:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.123122:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.123124:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.123132:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380519.123177:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.123183:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a1f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.123192:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=529s v=(0 0) 00002000:00010000:2.0:1787380519.123420:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.123426:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a1fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.123434:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.123437:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.123441:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a1fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.123515:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.123520:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a1f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.123530:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a1f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.123539:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a1f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.123546:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a1f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.123624:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787380519.123790:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a1fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.123799:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a1fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.123830:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a1fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380519.124213:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.124220:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a204 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.124228:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.124231:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.124236:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.124245:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.124253:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.124266:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a204 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.124386:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787380519.124393:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a1f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.124411:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866e00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380519.124415:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a1f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.124424:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a1f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.124441:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a1f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.124458:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a1f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.124476:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787380519.124480:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a1fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.124487:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9aa00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380519.124490:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a1fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.124497:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a1fd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.124508:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a1fd lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.124521:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380519.124525:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a204 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.124531:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867a00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380519.124535:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a204 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.124542:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a204 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.124553:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a204 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.124560:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.124562:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.124564:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.124667:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787380519.124673:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a1fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.124881:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787380519.125192:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.125269:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000560668c4/0xcf3c46fdcad6a20b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.125280:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.125283:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.125288:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000560668c4/0xcf3c46fdcad6a20b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.125299:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000560668c4/0xcf3c46fdcad6a20b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.125307:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000560668c4/0xcf3c46fdcad6a20b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.125314:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000560668c4/0xcf3c46fdcad6a20b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.125354:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787380519.125639:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380519.125645:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000560668c4/0xcf3c46fdcad6a20b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.125654:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46e00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380519.125658:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000560668c4/0xcf3c46fdcad6a20b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.125678:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000560668c4/0xcf3c46fdcad6a20b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.125693:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000560668c4/0xcf3c46fdcad6a20b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.125701:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000560668c4/0xcf3c46fdcad6a20b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.125716:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.125718:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.125720:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787380519.125794:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.125800:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb666bbc/0xcf3c46fdcad6a212 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.125991:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.125994:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.125999:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb666bbc/0xcf3c46fdcad6a212 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.126008:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb666bbc/0xcf3c46fdcad6a212 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.126015:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb666bbc/0xcf3c46fdcad6a212 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.126022:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb666bbc/0xcf3c46fdcad6a212 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.126043:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787380519.126418:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.126425:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e4882f5/0xcf3c46fdcad6a219 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.126433:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.126435:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.126440:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e4882f5/0xcf3c46fdcad6a219 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.126516:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e4882f5/0xcf3c46fdcad6a219 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.126539:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e4882f5/0xcf3c46fdcad6a219 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.126545:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e4882f5/0xcf3c46fdcad6a219 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.126557:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787380519.126793:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.126799:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008abcbaa8/0xcf3c46fdcad6a220 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.126956:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787380519.126962:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb666bbc/0xcf3c46fdcad6a212 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.126969:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47e00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380519.126973:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb666bbc/0xcf3c46fdcad6a212 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.126982:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb666bbc/0xcf3c46fdcad6a212 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.126995:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb666bbc/0xcf3c46fdcad6a212 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.127014:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb666bbc/0xcf3c46fdcad6a212 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.127125:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.127129:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.127133:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008abcbaa8/0xcf3c46fdcad6a220 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.127143:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008abcbaa8/0xcf3c46fdcad6a220 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.127150:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008abcbaa8/0xcf3c46fdcad6a220 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.127156:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008abcbaa8/0xcf3c46fdcad6a220 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.127177:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787380519.127283:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787380519.127287:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e4882f5/0xcf3c46fdcad6a219 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.127294:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47c00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380519.127297:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e4882f5/0xcf3c46fdcad6a219 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.127305:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e4882f5/0xcf3c46fdcad6a219 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.127315:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e4882f5/0xcf3c46fdcad6a219 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.127321:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e4882f5/0xcf3c46fdcad6a219 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.127332:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380519.127335:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008abcbaa8/0xcf3c46fdcad6a220 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.127341:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47400 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380519.127351:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008abcbaa8/0xcf3c46fdcad6a220 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.127358:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008abcbaa8/0xcf3c46fdcad6a220 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.127369:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008abcbaa8/0xcf3c46fdcad6a220 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.127376:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008abcbaa8/0xcf3c46fdcad6a220 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.127388:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.127390:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.127391:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.127400:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.127784:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787380519.127791:0:19267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a204 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.128144:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787380519.128679:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.128686:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a29ee17/0xcf3c46fdcad6a227 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.128697:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.128700:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.128704:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a29ee17/0xcf3c46fdcad6a227 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.128714:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a29ee17/0xcf3c46fdcad6a227 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.128722:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a29ee17/0xcf3c46fdcad6a227 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.128729:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a29ee17/0xcf3c46fdcad6a227 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.128749:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787380519.128996:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.129002:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a22e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.129010:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.129013:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.129018:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a22e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.129027:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a22e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.129034:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a22e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.129041:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a22e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.129075:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787380519.129801:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787380519.129829:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a29ee17/0xcf3c46fdcad6a227 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.129839:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46a00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380519.129843:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a29ee17/0xcf3c46fdcad6a227 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.129852:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a29ee17/0xcf3c46fdcad6a227 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.129959:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a29ee17/0xcf3c46fdcad6a227 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.129967:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a29ee17/0xcf3c46fdcad6a227 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.129989:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380519.129993:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a22e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.129999:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866c00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380519.130002:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a22e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.130009:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a22e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.130017:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a22e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.130024:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a22e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.130035:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.130037:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.130044:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.130051:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787380519.130365:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.130372:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000482b1e2c/0xcf3c46fdcad6a235 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.130382:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.130391:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.130396:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000482b1e2c/0xcf3c46fdcad6a235 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.130407:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000482b1e2c/0xcf3c46fdcad6a235 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.130415:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000482b1e2c/0xcf3c46fdcad6a235 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.130422:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000482b1e2c/0xcf3c46fdcad6a235 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.130441:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787380519.130587:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.130593:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a23c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.130600:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.130602:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.130606:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a23c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.130614:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a23c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.130621:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a23c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.130628:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a23c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.130654:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787380519.130800:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787380519.130806:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000482b1e2c/0xcf3c46fdcad6a235 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.130833:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47a00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:3.0:1787380519.130837:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000482b1e2c/0xcf3c46fdcad6a235 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.130857:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000482b1e2c/0xcf3c46fdcad6a235 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.130871:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000482b1e2c/0xcf3c46fdcad6a235 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.130878:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000482b1e2c/0xcf3c46fdcad6a235 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.130896:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787380519.130899:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a23c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.130905:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866600 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:3.0:1787380519.130908:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a23c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.130916:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a23c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.130929:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a23c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.130936:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a23c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.130954:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380519.130960:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380519.130962:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380519.130964:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787380519.136680:0:18707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787380519.136694:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a243 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.136711:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=529s v=(0 0) 00010000:00010000:3.0:1787380519.136715:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380519.136721:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a243 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.136735:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a243 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.136744:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a243 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.136753:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a243 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.136781:0:18707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1787380519.137330:0:18707:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1787380519.137423:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17224:x1874203867541504:12345-0@lo:5:osp-pre-0-0.0 Request processed in 76373us (76821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380519.137433:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787380519.137548:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787380519.137559:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17943:x1874203867542016:12345-0@lo:7:osp-pre-1-1.0 00010000:00010000:1.0:1787380519.140971:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380519.140983:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a243 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.140997:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89d400 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380519.141002:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a243 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.141014:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a243 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.141034:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a243 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.141042:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064178293/0xcf3c46fdcad6a243 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.141077:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.141079:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.141080:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380519.141130:0:17224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d79f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17224:1874203867541504:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787380519.141143:0:17224:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1787380519.141187:0:17224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d79f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17224:1874203867542144:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787380519.141562:0:17224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380519.141599:0:17224:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041a000 going to sleep for 11 seconds 00002000:00010000:1.0:1787380519.141675:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787380519.141682:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a24a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.141693:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1787380519.141698:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380519.141703:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a24a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.141716:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a24a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.141725:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a24a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.141733:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a24a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.141751:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787380519.141760:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380519.141764:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a24a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.141770:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df0e00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380519.141774:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a24a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.141793:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a24a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.141805:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a24a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.141833:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a24a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.141848:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.141849:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.141851:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380519.145395:0:18704:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787380519.145412:0:18704:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00080000:3.0:1787380519.147579:0:18707:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1787380519.147588:0:18707:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787380519.147680:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17943:x1874203867542016:12345-0@lo:7:osp-pre-1-1.0 Request processed in 10121us (76007us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380519.147691:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787380519.147721:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867542144 00000100:00100000:3.0:1787380519.147728:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867542144 00000100:00100000:3.0:1787380519.147770:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787380519.147779:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17224:x1874203867542144:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787380519.148544:0:18706:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000100:00100000:2.0:1787380519.150593:0:17943:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17943:1874203867542016:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1787380519.150610:0:17943:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1787380519.150647:0:17943:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3f8e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17943:1874203867542272:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787380519.150697:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380519.150727:0:17943:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc39ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1787380519.150761:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867542272 00000100:00100000:2.0:1787380519.150766:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867542272 00000100:00100000:2.0:1787380519.152095:0:19599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787380519.152111:0:19599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17943:x1874203867542272:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787380519.152142:0:19599:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1787380519.152619:0:17943:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3f8e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17943:1874203867542272:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787380519.152636:0:17943:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1787380519.152670:0:17943:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17943:1874203867542400:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1787380519.155304:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380519.155344:0:17943:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd2494000 going to sleep for 11 seconds 00000100:00100000:3.0:1787380519.155367:0:18704:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:3.0:1787380519.155375:0:18704:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00000100:00100000:3.0:1787380519.155608:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867542400 00000100:00100000:3.0:1787380519.155616:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867542400 00000100:00100000:3.0:1787380519.155731:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787380519.155740:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+7:17943:x1874203867542400:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787380519.155779:0:19601:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000100:00100000:2.0:1787380519.156356:0:19599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+7:17943:x1874203867542272:12345-0@lo:5:osp-pre-1-1.0 Request processed in 4248us (5655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380519.156373:0:19599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00002000:00010000:0.0:1787380519.165962:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.165976:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a251 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.165994:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.166006:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.166013:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a251 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.166029:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a251 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.166039:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a251 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.166047:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a251 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.166076:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787380519.166706:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380519.166715:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a251 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.166724:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866a00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380519.166728:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a251 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.166737:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a251 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.166757:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a251 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.166766:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a251 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.166784:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.166786:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.166788:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380519.167777:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.167787:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a258 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.167799:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.167803:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.167838:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a258 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.167852:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a258 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.168412:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a258 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.168429:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a258 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.168481:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787380519.169274:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380519.169283:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a258 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.169293:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866600 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380519.169298:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a258 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.169317:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a258 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.169334:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a258 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.169341:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a258 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.169357:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.169359:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.169360:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787380519.169694:0:18701:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1787380519.169732:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787380519.170416:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17224:x1874203867542144:12345-0@lo:5:osp-pre-0-0.0 Request processed in 22633us (28850us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787380519.170427:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787380519.171564:0:17224:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1787380519.171576:0:17224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d79f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17224:1874203867542144:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787380519.171591:0:17224:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00002000:00010000:0.0:1787380519.173981:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.173996:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a25f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.174012:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.174016:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.174022:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a25f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.174036:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a25f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.174045:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a25f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.174054:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a25f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.174087:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787380519.174105:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380519.174110:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a25f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.174117:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866c00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.174121:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a25f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.174131:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a25f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.174148:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a25f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.174155:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a25f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.174173:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.174175:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.174177:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380519.178074:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.178087:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a266 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.178103:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.178108:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.178113:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a266 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.178141:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a266 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.178152:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a266 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.178161:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a266 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.178181:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787380519.178193:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380519.178956:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a266 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.178969:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866e00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.178974:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a266 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.178984:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a266 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.179002:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a266 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.179010:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8fba6e3/0xcf3c46fdcad6a266 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.179035:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.179037:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.179039:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787380519.181129:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.181142:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010a41bf9/0xcf3c46fdcad6a26d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.181158:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.181162:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.181168:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010a41bf9/0xcf3c46fdcad6a26d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.181182:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010a41bf9/0xcf3c46fdcad6a26d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.181268:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010a41bf9/0xcf3c46fdcad6a26d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.181277:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010a41bf9/0xcf3c46fdcad6a26d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.181296:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787380519.181309:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380519.181314:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010a41bf9/0xcf3c46fdcad6a26d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.181321:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46000 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380519.181326:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010a41bf9/0xcf3c46fdcad6a26d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.181337:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010a41bf9/0xcf3c46fdcad6a26d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.181354:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010a41bf9/0xcf3c46fdcad6a26d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.181362:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010a41bf9/0xcf3c46fdcad6a26d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.181381:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.181388:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.181390:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787380519.182009:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787380519.182017:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d5fb913/0xcf3c46fdcad6a274 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.182028:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=529s v=(0 0) 00010000:00010000:2.0:1787380519.182031:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380519.182036:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d5fb913/0xcf3c46fdcad6a274 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.182047:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d5fb913/0xcf3c46fdcad6a274 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.182054:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d5fb913/0xcf3c46fdcad6a274 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.182073:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d5fb913/0xcf3c46fdcad6a274 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.182089:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787380519.182097:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380519.182102:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d5fb913/0xcf3c46fdcad6a274 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.182109:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47800 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380519.182113:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d5fb913/0xcf3c46fdcad6a274 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.182133:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d5fb913/0xcf3c46fdcad6a274 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.182146:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d5fb913/0xcf3c46fdcad6a274 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.182153:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d5fb913/0xcf3c46fdcad6a274 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.182167:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.182169:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.182171:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380519.185493:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.185503:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a27b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.185519:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.185523:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.185529:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a27b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.185543:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a27b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.185552:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a27b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.185560:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a27b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.185579:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787380519.185590:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380519.185595:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a27b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.185615:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866c00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.185620:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a27b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.185634:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a27b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.185650:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a27b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.185657:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e1545e4/0xcf3c46fdcad6a27b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.185672:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.185674:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.185676:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380519.186151:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.186159:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a282 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.186169:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.186172:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.186176:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a282 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.186185:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a282 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.186211:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a282 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.186219:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a282 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.186235:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787380519.186438:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380519.186446:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a282 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.186462:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866600 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380519.186466:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a282 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.186474:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a282 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.186574:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a282 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380519.186592:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.186598:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a289 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.186601:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d71a9ec2/0xcf3c46fdcad6a282 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.186606:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.186609:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.186613:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a289 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.186616:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.186618:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.186620:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.186621:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a289 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.186629:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a289 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.186636:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a289 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.186663:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787380519.186670:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380519.186674:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a289 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.186681:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866a00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.186684:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a289 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.186692:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a289 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.186703:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a289 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.186711:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a289 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.186725:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.186726:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.186727:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380519.187108:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.187114:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a290 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187123:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.187131:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.187136:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a290 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187145:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a290 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187153:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a290 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187160:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a290 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187175:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787380519.187478:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.187484:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a297 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187493:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.187495:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.187499:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a297 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187507:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a297 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187514:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a297 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187528:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a297 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187543:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787380519.187552:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787380519.187555:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a290 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187562:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7867a00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.187565:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a290 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187573:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a290 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187584:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a290 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187591:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014e2253d/0xcf3c46fdcad6a290 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187604:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380519.187607:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a297 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187624:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9aa00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.187627:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a297 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187635:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a297 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187645:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a297 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187652:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a297 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.187665:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.187667:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.187669:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.187985:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380519.189044:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.189054:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a29e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.189081:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.189084:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.189089:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a29e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.189100:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a29e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.189116:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a29e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.189124:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a29e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.189139:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787380519.189148:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380519.189153:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a29e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.189160:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9a000 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.189164:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a29e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.189172:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a29e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.189186:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a29e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.189194:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a29e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.189967:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.189974:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.189976:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380519.195596:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.195609:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a2a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.195625:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.195629:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.195635:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a2a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.195648:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a2a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.195658:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a2a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.195666:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a2a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.195692:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787380519.197520:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.197532:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a2ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.197547:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.197551:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.197556:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a2ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.197575:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a2ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.197585:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a2ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.197593:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a2ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.197609:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787380519.197620:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787380519.197625:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a2a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.197632:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9ba00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.197637:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a2a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.197645:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a2a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.197660:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a2a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.197666:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc30aa34/0xcf3c46fdcad6a2a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.197687:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380519.197691:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a2ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.197697:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9a600 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.197700:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a2ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.197707:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a2ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.197717:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a2ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.197724:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eeed0f52/0xcf3c46fdcad6a2ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.197735:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.197737:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.197738:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.197958:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380519.198679:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.198688:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.198699:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.198703:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.198714:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.198725:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.198733:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.198740:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.198754:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787380519.198763:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380519.198767:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.198774:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9b400 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380519.198778:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.198785:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.198797:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.199052:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.199077:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.199078:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.199080:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787380519.199715:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.199723:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a2ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.199733:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.199737:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.199741:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a2ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.199751:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a2ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.199759:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a2ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.199766:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a2ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.200073:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787380519.203171:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.203190:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a2c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.203260:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.203265:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.203271:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a2c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.203286:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a2c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.203294:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a2c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.203301:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a2c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.205733:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787380519.205745:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a2ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.205757:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9a000 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380519.205761:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a2ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.205770:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a2ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.205788:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a2ba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.205795:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f86efd3/0xcf3c46fdcad6a2ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.205833:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380519.205849:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a2c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.205856:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9aa00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380519.205871:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a2c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.205880:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a2c1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.205892:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a2c1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.205900:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.205901:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380519.205903:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787380519.209025:0:19519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1787380519.209074:0:19519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1787380519.209078:0:19519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787380519.209341:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:17943:x1874203867542400:12345-0@lo:5:osp-pre-1-1.0 Request processed in 53598us (54036us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787380519.209351:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787380519.209353:0:17943:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787380519.209360:0:17943:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17943:1874203867542400:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1787380519.209382:0:17943:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1787380519.209432:0:17943:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17943:1874203867542528:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1787380519.209466:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:3.0:1787380519.209468:0:17943:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787380519.209475:0:19267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab4f016c/0xcf3c46fdcad6a2c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380519.209504:0:17943:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4d17c00 going to sleep for 11 seconds 00002000:00010000:0.0:1787380519.210092:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787380519.210100:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.210111:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=529s v=(0 0) 00010000:00010000:0.0:1787380519.210115:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380519.210126:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.210139:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.210147:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.210153:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380519.210222:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867542528 00000100:00100000:2.0:1787380519.210229:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867542528 00000100:00100000:2.0:1787380519.210277:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787380519.210285:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17943:x1874203867542528:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787380519.210337:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17943:x1874203867542528:12345-0@lo:900:osp-pre-1-1.0 Request processed in 53us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380519.210344:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787380519.210453:0:17943:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff3fc1180 x1874203867542528/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787380535 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380519.210464:0:17943:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17943:1874203867542528:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1787380519.210567:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787380519.210574:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.210582:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe0a9b400 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:1.0:1787380519.210586:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.210607:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2c8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.210623:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2c8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.210631:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.210632:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.210634:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380519.210786:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787380519.210793:0:19267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f01b06f3/0xcf3c46fdcad6a2c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787380519.212012:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787380519.212022:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a2cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.212033:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1787380519.212037:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380519.212043:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a2cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.212053:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a2cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.212075:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a2cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.212083:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a2cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.213987:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787380519.214006:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a2cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.214018:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df0e00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380519.214022:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a2cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.214032:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a2cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.214051:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a2cf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.214234:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380519.214237:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380519.214239:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380519.215072:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787380519.215082:0:19267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7d16c8d/0xcf3c46fdcad6a2cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.215629:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787380519.215740:0:19267:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787380519.215747:0:19267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad269599/0xcf3c46fdcad6a2d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.215760:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=529s v=(0 0) 00010000:00010000:1.0:1787380519.215765:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380519.215771:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad269599/0xcf3c46fdcad6a2d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.215784:0:19267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad269599/0xcf3c46fdcad6a2d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.215792:0:19267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad269599/0xcf3c46fdcad6a2d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.215799:0:19267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad269599/0xcf3c46fdcad6a2d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380519.216302:0:19267:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787380519.216352:0:19267:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:1.0:1787380519.216494:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17226:x1874203867541760:12345-0@lo:5:osp-pre-1-0.0 Request processed in 144732us (144903us total) trans 0 rc 0/0 00010000:00010000:3.0:1787380519.216512:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787380519.216513:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787380519.216519:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad269599/0xcf3c46fdcad6a2d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.216649:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1400 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:3.0:1787380519.216655:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad269599/0xcf3c46fdcad6a2d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.216675:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad269599/0xcf3c46fdcad6a2d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.216692:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad269599/0xcf3c46fdcad6a2d6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.216700:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad269599/0xcf3c46fdcad6a2d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.217043:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380519.217045:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380519.217047:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380519.218560:0:17226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44a9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17226:1874203867541760:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787380519.218578:0:17226:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1787380519.219048:0:17226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44a9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17226:1874203867542656:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787380519.219113:0:17226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380519.219149:0:17226:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5240 going to sleep for 11 seconds 00000100:00100000:1.0:1787380519.219194:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867542656 00000100:00100000:1.0:1787380519.219262:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867542656 00000100:00100000:1.0:1787380519.219313:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787380519.219322:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17226:x1874203867542656:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787380519.219362:0:18704:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:1.0:1787380519.223117:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17226:x1874203867542656:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3790us (3997us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787380519.223131:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787380519.223293:0:17226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44a9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17226:1874203867542656:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787380519.223306:0:17226:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:0.0:1787380519.563950:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867542784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380519.564014:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380519.564052:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867542912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787380519.564086:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380519.564094:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867542784 00000100:00100000:3.0:1787380519.564101:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867542784 00000100:00100000:3.0:1787380519.564138:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867542912 00000100:00100000:3.0:1787380519.564142:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867542912 00000100:00100000:3.0:1787380519.564156:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787380519.564165:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867542784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787380519.564195:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787380519.564354:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867542784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 188us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380519.564403:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867542784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380519.565308:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787380519.565323:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867542912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787380519.565349:0:17939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787380519.565411:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867542912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380519.565417:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787380519.567713:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867542912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787380519.572631:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 10000000:01000000:3.0:1787380519.820933:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787380519.820940:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6ff3daa800 from 10 10000000:01000000:3.0:1787380519.820944:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787380519.820985:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d400/0xcf3c46fdcad6a2dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.820996:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d400/0xcf3c46fdcad6a2dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.821006:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d400/0xcf3c46fdcad6a2dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380519.821028:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867543040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787380519.821098:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380519.821139:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4d17480 going to sleep for 11 seconds 00000100:00100000:2.0:1787380519.821193:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867543040 00000100:00100000:2.0:1787380519.821200:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867543040 00000100:00100000:2.0:1787380519.821251:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787380519.821260:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:17196:x1874203867543040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787380519.821271:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380519.821283:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5d46400/0xcf3c46fdcad6a2e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6a2dd expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.821315:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5d46400/0xcf3c46fdcad6a2e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a2dd expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.821335:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5d46400/0xcf3c46fdcad6a2e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a2dd expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.821343:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46400, rc 0) 00000100:00100000:2.0:1787380519.821384:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed00c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:17196:x1874203867543040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380519.821391:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787380519.821398:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867543040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380519.821410:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d400/0xcf3c46fdcad6a2dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a2e4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.821419:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d400/0xcf3c46fdcad6a2dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad6a2e4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380519.821465:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867543168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787380519.821497:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380519.821523:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5240 going to sleep for 11 seconds 00000100:00100000:0.0:1787380519.821540:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867543168 00000100:00100000:0.0:1787380519.821544:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867543168 00000100:00100000:0.0:1787380519.821565:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787380519.821570:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:17196:x1874203867543168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787380519.821582:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787380519.821597:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787380519.821600:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1787380519.821742:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:17196:x1874203867543168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380519.821749:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787380519.821782:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867543168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787380519.821855:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787380519.821861:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d400/0xcf3c46fdcad6a2dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a2e4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.821876:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d400/0xcf3c46fdcad6a2dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a2e4 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380519.821884:0:17196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787380519.821886:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9d6ec3e05800 from 10 10000000:01000000:0.0:1787380519.821889:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787380519.821903:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9b400/0xcf3c46fdcad6a2eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.821909:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9b400/0xcf3c46fdcad6a2eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.821915:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9b400/0xcf3c46fdcad6a2eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380519.821926:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867543296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787380519.821948:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380519.821966:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ec25a5240 going to sleep for 11 seconds 00000100:00100000:0.0:1787380519.821975:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867543296 00000100:00100000:0.0:1787380519.821978:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867543296 00000100:00100000:0.0:1787380519.821996:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787380519.822000:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:17196:x1874203867543296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380519.822006:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380519.822013:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9aa00/0xcf3c46fdcad6a2f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6a2eb expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.822035:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9aa00/0xcf3c46fdcad6a2f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a2eb expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.822043:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9aa00/0xcf3c46fdcad6a2f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a2eb expref: 24 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380519.822050:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9aa00, rc 0) 00000100:00100000:0.0:1787380519.822094:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:17196:x1874203867543296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380519.822101:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787380519.822105:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867543296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380519.822115:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9b400/0xcf3c46fdcad6a2eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a2f2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.822123:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9b400/0xcf3c46fdcad6a2eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad6a2f2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380519.822163:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867543424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787380519.822191:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380519.822206:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fc4d179c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380519.822217:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867543424 00000100:00100000:3.0:1787380519.822220:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867543424 00000100:00100000:3.0:1787380519.822243:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787380519.822248:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:17196:x1874203867543424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787380519.822258:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787380519.822268:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787380519.822271:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1787380519.822343:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:17196:x1874203867543424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 94us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380519.822349:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787380519.822374:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867543424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787380519.822404:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787380519.822409:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9b400/0xcf3c46fdcad6a2eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a2f2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380519.822416:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9b400/0xcf3c46fdcad6a2eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a2f2 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380519.826391:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787380520.524625:0:17958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787380520.853243:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380521.868088:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380522.892160:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787380523.865119:0:19878:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg630-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787380523.924420:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380524.172211:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787380524.172232:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867543680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787380524.172320:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380524.172354:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867543552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380524.172384:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867543680 00000100:00100000:2.0:1787380524.172384:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380524.172390:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867543680 00000100:00100000:2.0:1787380524.172428:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867543552 00000100:00100000:2.0:1787380524.172432:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867543552 00000100:00100000:3.0:1787380524.172433:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787380524.172442:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867543680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787380524.172467:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787380524.172518:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867543680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380524.172525:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787380524.172540:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787380524.172545:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874203867543552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787380524.172555:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787380524.172582:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874203867543552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380524.172587:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787380524.172602:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787380524.172634:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867543552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380524.172759:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867543680:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380524.172882:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867543808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787380524.172913:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867543936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380524.172914:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380524.172945:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867543808 00000100:00100000:2.0:1787380524.172949:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867543808 00000100:00100000:1.0:1787380524.172957:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380524.172978:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867543936 00000100:00100000:2.0:1787380524.172982:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867543936 00000100:00100000:2.0:1787380524.173000:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787380524.173007:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867543808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787380524.173025:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787380524.173070:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867543808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380524.173092:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787380524.173105:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787380524.173111:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867543936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787380524.173121:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787380524.173152:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867543936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380524.173158:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787380524.173190:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867543808:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787380524.173363:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380524.173373:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867544320:0@lo:400:kworker.0 00000100:00100000:1.0:1787380524.173394:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867544448:0@lo:400:kworker.0 00000100:00100000:3.0:1787380524.173405:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380524.173433:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380524.173437:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867544832:0@lo:400:kworker.0 00000100:00100000:1.0:1787380524.173462:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867544960:0@lo:400:kworker.0 00000100:00100000:3.0:1787380524.173467:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380524.173494:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787380524.173499:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380524.173503:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867544192:0@lo:400:kworker.0 00000100:00100000:3.0:1787380524.174417:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380524.174457:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1874203867544704:0@lo:400:kworker.0 00000100:00100000:3.0:1787380524.174487:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380524.174510:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867544320 00000100:00100000:3.0:1787380524.174515:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867544320 00000100:00100000:3.0:1787380524.174541:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867544832 00000100:00100000:3.0:1787380524.174543:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867544832 00000100:00100000:3.0:1787380524.174563:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867544960 00000100:00100000:3.0:1787380524.174565:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867544960 00000100:00100000:3.0:1787380524.174577:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867544704 00000100:00100000:3.0:1787380524.174580:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867544704 00000100:00100000:3.0:1787380524.174592:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787380524.174598:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867544320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380524.174641:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867544320:12345-0@lo:400:kworker.0 Request processed in 42us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380524.175599:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787380524.175625:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787380524.175633:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867544832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380524.176125:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867544832:12345-0@lo:400:kworker.0 Request processed in 492us (2657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380524.176132:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787380524.176871:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867544448 00000100:00100000:2.0:1787380524.176881:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867544448 00000100:00100000:2.0:1787380524.176929:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867544192 00000100:00100000:2.0:1787380524.176933:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867544192 00000100:00100000:2.0:1787380524.176948:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787380524.176955:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867544448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380524.177006:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867544448:12345-0@lo:400:kworker.0 Request processed in 50us (3573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380524.177012:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787380524.177047:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787380524.177053:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867544192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380524.177084:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867544192:12345-0@lo:400:kworker.0 Request processed in 32us (2670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380524.177090:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787380524.178272:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3d79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867543936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380524.178308:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867544448:0@lo:400:kworker.0 00000100:00100000:1.0:1787380524.178319:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1787380524.178328:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867544064:0@lo:400:kworker.0 00000100:00100000:1.0:1787380524.178371:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380524.178427:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff3fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867544576:0@lo:400:kworker.0 00000100:00100000:1.0:1787380524.178451:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380524.178462:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867545088:0@lo:400:kworker.0 00000100:00100000:1.0:1787380524.178481:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380524.178506:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867544576 00000100:00100000:1.0:1787380524.178521:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867544576 00000100:00100000:0.0:1787380524.178580:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867544064 00000100:00100000:0.0:1787380524.178584:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867544064 00000100:00100000:0.0:1787380524.178613:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787380524.178620:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:3641:x1874203867544064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380524.178680:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:3641:x1874203867544064:12345-0@lo:400:kworker.0 Request processed in 60us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380524.178687:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787380524.179204:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787380524.179220:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867544960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380524.179256:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867544064:0@lo:400:kworker.0 00000100:00100000:3.0:1787380524.179278:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1874203867544960:12345-0@lo:400:kworker.0 Request processed in 62us (5779us total) trans 0 rc 0/0 00010000:00080000:0.0:1787380524.179280:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff3fc1180 x1874203867544960/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380524.179299:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3641:1874203867544960:0@lo:400:kworker.0 00000100:00100000:2.0:1787380524.179346:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787380524.179356:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874203867544704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380524.179394:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1874203867544704:12345-0@lo:400:kworker.0 Request processed in 40us (4905us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380524.179407:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787380524.179423:0:17200:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787380524.179429:0:17200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787380524.179984:0:17199:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787380524.179994:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867545088 00000100:00100000:1.0:1787380524.179998:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867545088 00000100:00100000:1.0:1787380524.180024:0:17199:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787380524.180042:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787380524.180049:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867544576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380524.180096:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867544576:12345-0@lo:400:kworker.0 Request processed in 47us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380524.180102:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787380524.180115:0:17199:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787380524.180121:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787380524.180126:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874203867545088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380524.180153:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874203867545088:12345-0@lo:400:kworker.0 Request processed in 27us (1671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380524.180158:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1787380524.180189:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff3fc2d80 x1874203867544576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380524.180200:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867544576:0@lo:400:kworker.0 00010000:00080000:1.0:1787380524.180209:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3c16300 x1874203867545088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787380524.180216:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867545088:0@lo:400:kworker.0 00000100:00080000:0.0:1787380524.180985:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787380524.180991:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787380524.181023:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867544192:0@lo:400:kworker.0 00010000:00080000:0.0:1787380524.181065:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff3fc2a00 x1874203867544704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380524.181075:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3640:1874203867544704:0@lo:400:kworker.0 00010000:00080000:0.0:1787380524.181087:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff3fc3800 x1874203867544320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380524.181096:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867544320:0@lo:400:kworker.0 00010000:00080000:0.0:1787380524.181107:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ff3fc3b80 x1874203867544832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380524.181115:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff3fc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867544832:0@lo:400:kworker.0 00000100:00100000:3.0:1787380524.184805:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000020:00000004:3.0:1787380524.642289:0:19931:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787380524.642525:0:19931:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787380524.684489:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867545216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787380524.684549:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380524.684582:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787380524.684588:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867545344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787380524.684637:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380524.684709:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867545216 00000100:00100000:1.0:1787380524.684715:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867545216 00000100:00100000:1.0:1787380524.684753:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867545344 00000100:00100000:1.0:1787380524.684756:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867545344 00000100:00100000:1.0:1787380524.684769:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787380524.684776:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867545216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787380524.684830:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787380524.684869:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867545216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380524.684876:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787380524.684892:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787380524.684899:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867545344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787380524.684913:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1787380524.684937:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867545344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 39us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380524.684943:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787380524.684984:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867545344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787380524.684997:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867545216:0@lo:41:osp-pre-1-0.0 00000001:00080000:2.0:1787380524.690711:0:19519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:0.0:1787380524.939959:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787380525.540894:0:19981:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787380525.541153:0:19981:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1787380525.802806:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380525.802999:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848591744 00000100:00100000:2.0:1787380525.803229:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848591744 00000100:00100000:2.0:1787380525.803281:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 115 00000100:00100000:2.0:1787380525.803289:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2396:x1874203848591744:12345-192.168.206.30@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787380525.803317:0:17194:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from ab8d4fb0-c401-4cf6-8006-07960a0f9a13@192.168.206.30@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:2.0:1787380525.803466:0:17194:0:(genops.c:1406:class_connect()) connect: client ab8d4fb0-c401-4cf6-8006-07960a0f9a13, cookie 0xcf3c46fdcad6a2f9 00000100:00080000:2.0:1787380525.803596:0:17194:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2749800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787380525.803661:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+5:2396:x1874203848591744:12345-192.168.206.30@tcp:250:mount.lustre.0 Request processed in 371us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380525.803669:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 115 00000100:00100000:3.0:1787380525.818100:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380525.818229:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848591872 00000100:00100000:2.0:1787380525.818239:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848591872 00000100:00100000:2.0:1787380525.818295:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 116 00000100:00100000:2.0:1787380525.818305:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+5:14894:x1874203848591872:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787380525.818321:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380525.818346:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5d46600/0xcf3c46fdcad6a300 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b00e expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380525.818373:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5d46600/0xcf3c46fdcad6a300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b00e expref: 6 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380525.818384:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5d46600/0xcf3c46fdcad6a300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b00e expref: 6 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380525.818410:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46600, rc 0) 00000100:00100000:2.0:1787380525.818467:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+6:14894:x1874203848591872:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 163us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380525.818474:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 116 00000100:00100000:1.0:1787380525.827704:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380525.828056:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848592000 00000100:00100000:2.0:1787380525.828066:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848592000 00000100:00100000:3.0:1787380525.828507:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 117 00000100:00100000:3.0:1787380525.828519:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+6:14894:x1874203848592000:12345-192.168.206.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787380525.828638:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+6:14894:x1874203848592000:12345-192.168.206.30@tcp:501:mount.lustre.0 Request processed in 121us (941us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787380525.828646:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 117 00000100:00100000:1.0:1787380525.835421:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380525.835576:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848592128 00000100:00100000:0.0:1787380525.835587:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848592128 00000100:00100000:0.0:1787380525.835644:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 118 00000100:00100000:0.0:1787380525.835654:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+6:14894:x1874203848592128:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787380525.835670:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380525.835685:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9ac00/0xcf3c46fdcad6a307 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b015 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380525.835713:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9ac00/0xcf3c46fdcad6a307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b015 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380525.835724:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9ac00/0xcf3c46fdcad6a307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b015 expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380525.835749:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9ac00, rc 0) 00000100:00100000:0.0:1787380525.835846:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+7:14894:x1874203848592128:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 193us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380525.835853:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 118 00000100:00100000:1.0:1787380525.838424:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380525.838517:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848592256 00000100:00100000:3.0:1787380525.838527:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848592256 00000100:00100000:3.0:1787380525.838583:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 119 00000100:00100000:3.0:1787380525.838593:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+7:14894:x1874203848592256:12345-192.168.206.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787380525.838738:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+8:14894:x1874203848592256:12345-192.168.206.30@tcp:501:mount.lustre.0 Request processed in 147us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380525.838746:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 119 00000100:00100000:1.0:1787380525.847724:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380525.847876:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848592384 00000100:00100000:2.0:1787380525.847886:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848592384 00000100:00100000:2.0:1787380525.847941:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 120 00000100:00100000:2.0:1787380525.847952:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+8:14894:x1874203848592384:12345-192.168.206.30@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787380525.848104:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+8:14894:x1874203848592384:12345-192.168.206.30@tcp:503:mount.lustre.0 Request processed in 153us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380525.848112:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 120 00000100:00100000:1.0:1787380525.851514:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380525.852051:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848592512 00000100:00100000:0.0:1787380525.852060:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848592512 00000100:00100000:0.0:1787380525.852111:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 121 00000100:00100000:0.0:1787380525.852119:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feed03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+8:14913:x1874203848592512:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787380525.852243:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feed03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+8:14913:x1874203848592512:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 124us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380525.852251:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 121 00000100:00100000:1.0:1787380525.876399:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380525.876484:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848592640 00000100:00100000:3.0:1787380525.876494:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848592640 00000100:00100000:3.0:1787380525.876547:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 122 00000100:00100000:3.0:1787380525.876555:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+8:14913:x1874203848592640:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787380525.876707:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+8:14913:x1874203848592640:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 151us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380525.876716:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 122 00000100:00100000:1.0:1787380525.884965:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380525.885067:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848592768 00000100:00100000:2.0:1787380525.885077:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848592768 00000100:00100000:2.0:1787380525.885133:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 123 00000100:00100000:2.0:1787380525.885143:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+8:14913:x1874203848592768:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787380525.885289:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef756850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+8:14913:x1874203848592768:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 147us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380525.885297:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 123 00000100:00100000:1.0:1787380525.894364:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380525.894430:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848592896 00000100:00100000:0.0:1787380525.894440:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848592896 00000100:00100000:0.0:1787380525.894505:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 124 00000100:00100000:0.0:1787380525.894515:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+8:14894:x1874203848592896:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787380525.894530:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380525.894547:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9be00/0xcf3c46fdcad6a30e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b046 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380525.894574:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9be00/0xcf3c46fdcad6a30e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b046 expref: 9 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380525.894584:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9be00/0xcf3c46fdcad6a30e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b046 expref: 9 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380525.894593:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9be00, rc 0) 00000100:00100000:0.0:1787380525.894666:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+9:14894:x1874203848592896:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 151us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380525.894673:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 124 00000100:00100000:1.0:1787380525.897978:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380525.898108:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848593024 00000100:00100000:3.0:1787380525.898117:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848593024 00000100:00100000:3.0:1787380525.898171:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 125 00000100:00100000:3.0:1787380525.898181:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+9:14894:x1874203848593024:12345-192.168.206.30@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787380525.898206:0:17194:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787380525.898228:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787380525.898232:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787380525.898235:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787380525.898238:0:17194:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1787380525.898240:0:17194:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1787380525.900606:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+9:14894:x1874203848593024:12345-192.168.206.30@tcp:256:mount.lustre.0 Request processed in 2419us (2628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380525.900620:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 125 00000100:00100000:1.0:1787380525.904659:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380525.904758:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848593152 00000100:00100000:2.0:1787380525.904768:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848593152 00000100:00100000:2.0:1787380525.904992:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 126 00000100:00100000:2.0:1787380525.905003:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+9:14894:x1874203848593152:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787380525.905043:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380525.905060:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a315 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b04d expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380525.905087:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b04d expref: 10 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380525.905098:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b04d expref: 10 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380525.905106:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d47e00, rc 0) 00000100:00100000:2.0:1787380525.905161:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef756050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+10:14894:x1874203848593152:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 161us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380525.905169:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 126 00000100:00100000:3.0:1787380525.906878:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380525.908482:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848593280 00000100:00100000:0.0:1787380525.908493:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848593280 00000100:00100000:0.0:1787380525.908540:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 127 00000100:00100000:0.0:1787380525.908550:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+10:14894:x1874203848593280:12345-192.168.206.30@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787380525.908698:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+10:14894:x1874203848593280:12345-192.168.206.30@tcp:501:mount.lustre.0 Request processed in 149us (1826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380525.908705:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 127 00000100:00100000:1.0:1787380525.911330:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380525.911395:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848593408 00000100:00100000:3.0:1787380525.911403:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848593408 00000100:00100000:3.0:1787380525.911469:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 128 00000100:00100000:3.0:1787380525.911479:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+10:14894:x1874203848593408:12345-192.168.206.30@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787380525.911872:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3625450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+10:14894:x1874203848593408:12345-192.168.206.30@tcp:503:mount.lustre.0 Request processed in 392us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380525.911881:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 128 00000100:00100000:1.0:1787380525.914798:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380525.916925:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848593536 00000100:00100000:3.0:1787380525.916938:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848593536 00000100:00100000:3.0:1787380525.917052:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 129 00000100:00100000:3.0:1787380525.917062:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+10:14918:x1874203848593536:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787380525.917205:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+10:14918:x1874203848593536:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 144us (2413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380525.917221:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 129 00000100:00100000:1.0:1787380525.930601:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380525.930682:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848593664 00000100:00100000:0.0:1787380525.930692:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848593664 00000100:00100000:0.0:1787380525.930746:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 130 00000100:00100000:0.0:1787380525.930756:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+10:14918:x1874203848593664:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787380525.930915:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3624850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+10:14918:x1874203848593664:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 160us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380525.930924:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 130 00000100:00100000:1.0:1787380525.953254:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380525.953343:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380525.953443:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848593792 00000100:00100000:0.0:1787380525.953460:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848593792 00000100:00100000:0.0:1787380525.953503:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848594048 00000100:00100000:0.0:1787380525.953507:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848594048 00000100:00100000:0.0:1787380525.953533:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:0.0:1787380525.953541:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1874203848593792:12345-192.168.206.30@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787380525.953569:0:17200:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 864e2bc1-2781-452d-8411-8f2a646f656c@192.168.206.30@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:0.0:1787380525.953616:0:17200:0:(genops.c:1406:class_connect()) connect: client 864e2bc1-2781-452d-8411-8f2a646f656c, cookie 0xcf3c46fdcad6a31c 00000004:00100000:0.0:1787380525.953639:0:17200:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787380525.953866:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9d6fee222000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787380525.953923:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+6:2396:x1874203848593792:12345-192.168.206.30@tcp:38:mount.lustre.0 Request processed in 381us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380525.953930:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:0.0:1787380525.953948:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:0.0:1787380525.953953:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1874203848594048:12345-192.168.206.30@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787380525.953967:0:17200:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from 864e2bc1-2781-452d-8411-8f2a646f656c@192.168.206.30@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:0.0:1787380525.953995:0:17200:0:(genops.c:1406:class_connect()) connect: client 864e2bc1-2781-452d-8411-8f2a646f656c, cookie 0xcf3c46fdcad6a323 00000004:00100000:0.0:1787380525.954007:0:17200:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787380525.954137:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9d6fee223800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787380525.954164:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+6:2396:x1874203848594048:12345-192.168.206.30@tcp:38:mount.lustre.0 Request processed in 210us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380525.954172:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 8 00010000:00010000:3.0:1787380525.964230:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380525.966899:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380525.966925:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380525.966955:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380525.967049:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848594176 00000100:00100000:3.0:1787380525.967058:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848594176 00000100:00100000:3.0:1787380525.967118:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848593920 00000100:00100000:3.0:1787380525.967121:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848593920 00000100:00100000:3.0:1787380525.967136:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848594304 00000100:00100000:3.0:1787380525.967139:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848594304 00000100:00100000:3.0:1787380525.967153:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:3.0:1787380525.967161:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+6:0:x1874203848594176:12345-192.168.206.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787380525.967195:0:17201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787380525.967265:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+6:0:x1874203848594176:12345-192.168.206.30@tcp:41:mount.lustre.0 Request processed in 104us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380525.967272:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:3.0:1787380525.967290:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:3.0:1787380525.967297:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+7:0:x1874203848593920:12345-192.168.206.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787380525.967326:0:17201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787380525.967361:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+7:0:x1874203848593920:12345-192.168.206.30@tcp:41:mount.lustre.0 Request processed in 64us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380525.967368:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:3.0:1787380525.967380:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:3.0:1787380525.967387:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+6:14894:x1874203848594304:12345-192.168.206.30@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787380525.967397:0:17201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1787380525.967418:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+6:14894:x1874203848594304:12345-192.168.206.30@tcp:41:mount.lustre.0 Request processed in 32us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380525.967440:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00080000:1.0:1787380525.967845:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787380525.967850:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787380525.972134:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380525.972242:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848594432 00000100:00100000:3.0:1787380525.972252:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848594432 00000100:00100000:3.0:1787380525.972429:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:3.0:1787380525.972440:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+6:14894:x1874203848594432:12345-192.168.206.30@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787380525.973744:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+6:14894:x1874203848594432:12345-192.168.206.30@tcp:40:mount.lustre.0 Request processed in 1299us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380525.973756:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 12 00000100:00100000:1.0:1787380525.978109:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380525.978187:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380525.978223:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380525.978301:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848594560 00000100:00100000:0.0:1787380525.978310:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848594560 00000100:00100000:0.0:1787380525.978358:0:19601:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848594688 00000100:00100000:0.0:1787380525.978361:0:19601:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848594688 00000100:00100000:0.0:1787380525.978380:0:19601:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:0.0:1787380525.978388:0:19601:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2396:x1874203848594560:12345-192.168.206.30@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787380525.978429:0:19601:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 864e2bc1-2781-452d-8411-8f2a646f656c@192.168.206.30@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:0.0:1787380525.978487:0:19601:0:(genops.c:1406:class_connect()) connect: client 864e2bc1-2781-452d-8411-8f2a646f656c, cookie 0xcf3c46fdcad6a32a 00002000:00100000:0.0:1787380525.978498:0:19601:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 864e2bc1-2781-452d-8411-8f2a646f656c/ffff9d6fee227800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787380525.978514:0:19601:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787380525.978736:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:1.0:1787380525.978743:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2396:x1874203848594688:12345-192.168.206.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787380525.978760:0:19267:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 864e2bc1-2781-452d-8411-8f2a646f656c@192.168.206.30@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:1.0:1787380525.978790:0:19267:0:(genops.c:1406:class_connect()) connect: client 864e2bc1-2781-452d-8411-8f2a646f656c, cookie 0xcf3c46fdcad6a331 00002000:00100000:1.0:1787380525.978831:0:19267:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 864e2bc1-2781-452d-8411-8f2a646f656c/ffff9d6ec3f4a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787380525.978842:0:19267:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787380525.978971:0:19267:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787380525.978998:0:19267:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3f48800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380525.979068:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:864e2bc1-2781-452d-8411-8f2a646f656c+6:2396:x1874203848594688:12345-192.168.206.30@tcp:8:mount.lustre.0 Request processed in 324us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380525.979076:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 17 00002000:00080000:0.0:1787380525.979740:0:19601:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787380525.979760:0:19601:0:(import.c:65:import_set_state_nolock()) ffff9d6fee224800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787380525.979952:0:19601:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:864e2bc1-2781-452d-8411-8f2a646f656c+6:2396:x1874203848594560:12345-192.168.206.30@tcp:8:mount.lustre.0 Request processed in 1563us (1764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380525.979962:0:19601:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:0.0:1787380525.981033:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848594816 00000100:00100000:0.0:1787380525.981042:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848594816 00000100:00100000:0.0:1787380525.981101:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:0.0:1787380525.981108:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff3fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:864e2bc1-2781-452d-8411-8f2a646f656c+6:14894:x1874203848594816:12345-192.168.206.30@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787380525.981162:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff3fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:864e2bc1-2781-452d-8411-8f2a646f656c+6:14894:x1874203848594816:12345-192.168.206.30@tcp:900:mount.lustre.0 Request processed in 54us (3061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380525.981169:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:1.0:1787380525.986551:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380525.986662:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848594944 00000100:00100000:3.0:1787380525.986675:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848594944 00000100:00100000:3.0:1787380525.986727:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:3.0:1787380525.986746:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:864e2bc1-2781-452d-8411-8f2a646f656c+6:14894:x1874203848594944:12345-192.168.206.30@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787380525.989392:0:17202:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2529us 00000004:00200000:3.0:1787380526.002579:0:17202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787380526.002779:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:864e2bc1-2781-452d-8411-8f2a646f656c+6:14894:x1874203848594944:12345-192.168.206.30@tcp:33:mount.lustre.0 Request processed in 16029us (16230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380526.002793:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:1.0:1787380526.222978:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380526.225957:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848595072 00000100:00100000:2.0:1787380526.225973:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848595072 00000100:00100000:2.0:1787380526.226117:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:2.0:1787380526.226128:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+6:14941:x1874203848595072:12345-192.168.206.30@tcp:101:mkdir.0 00010000:00010000:2.0:1787380526.226147:0:19900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380526.226170:0:19900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a338 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b07e expref: -99 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380526.226232:0:19900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a33f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380526.226262:0:19900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a33f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380526.226288:0:19900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a33f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380526.226333:0:19900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787380526.226337:0:19900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787380526.226383:0:19900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a33f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380526.226408:0:19900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a338 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b07e expref: 8 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380526.226426:0:19900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a33f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b07e expref: 7 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380526.226435:0:19900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25a9f00) 00010000:00010000:2.0:1787380526.226437:0:19900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787380526.226440:0:19900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d47400, rc 0) 00000100:00100000:2.0:1787380526.226504:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+7:14941:x1874203848595072:12345-192.168.206.30@tcp:101:mkdir.0 Request processed in 378us (3534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380526.226512:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 13 00000040:00080000:2.0:1787380526.348483:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787380526.989700:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380528.012177:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380528.114881:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380528.114970:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848595200 00000100:00100000:2.0:1787380528.114980:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848595200 00000100:00100000:2.0:1787380528.115059:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:2.0:1787380528.115070:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:864e2bc1-2781-452d-8411-8f2a646f656c+7:14994:x1874203848595200:12345-192.168.206.30@tcp:41:lfs.0 00000004:00000024:2.0:1787380528.115118:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787380528.115205:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:864e2bc1-2781-452d-8411-8f2a646f656c+7:14994:x1874203848595200:12345-192.168.206.30@tcp:41:lfs.0 Request processed in 136us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380528.115212:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00080000:1.0:1787380528.115401:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787380528.117237:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380528.117309:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848595328 00000100:00100000:0.0:1787380528.117317:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848595328 00000100:00100000:0.0:1787380528.117378:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:0.0:1787380528.117389:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+6:14994:x1874203848595328:12345-192.168.206.30@tcp:41:lfs.0 00000004:00000024:0.0:1787380528.117423:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787380528.117518:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+6:14994:x1874203848595328:12345-192.168.206.30@tcp:41:lfs.0 Request processed in 131us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380528.117526:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00080000:1.0:1787380528.117694:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787380528.119976:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380528.120084:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848595456 00000100:00100000:1.0:1787380528.120093:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848595456 00000100:00100000:1.0:1787380528.120160:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:1.0:1787380528.120169:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:864e2bc1-2781-452d-8411-8f2a646f656c+6:14994:x1874203848595456:12345-192.168.206.30@tcp:13:lfs.0 00002000:00000024:1.0:1787380528.120200:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787380528.120316:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:864e2bc1-2781-452d-8411-8f2a646f656c+6:14994:x1874203848595456:12345-192.168.206.30@tcp:13:lfs.0 Request processed in 147us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380528.120323:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00080000:0.0:1787380528.120550:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787380528.122325:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380528.122423:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848595584 00000100:00100000:1.0:1787380528.122432:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848595584 00000100:00100000:1.0:1787380528.122516:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:1.0:1787380528.122525:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:864e2bc1-2781-452d-8411-8f2a646f656c+6:14994:x1874203848595584:12345-192.168.206.30@tcp:13:lfs.0 00002000:00000024:1.0:1787380528.122556:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787380528.122644:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:864e2bc1-2781-452d-8411-8f2a646f656c+6:14994:x1874203848595584:12345-192.168.206.30@tcp:13:lfs.0 Request processed in 120us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380528.122652:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00080000:0.0:1787380528.122776:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787380528.317875:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380528.318076:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848595712 00000100:00100000:0.0:1787380528.318086:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848595712 00000100:00100000:0.0:1787380528.318140:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 131 00000100:00100000:0.0:1787380528.318150:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+10:15028:x1874203848595712:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787380528.318177:0:17192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380528.318195:0:17192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9ae00/0xcf3c46fdcad6a346 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b085 expref: -99 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380528.318221:0:17192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9ae00/0xcf3c46fdcad6a346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b085 expref: 11 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380528.318232:0:17192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9ae00/0xcf3c46fdcad6a346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b085 expref: 11 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380528.318241:0:17192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9ae00, rc 0) 00000100:00100000:0.0:1787380528.318299:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3626050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+11:15028:x1874203848595712:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 151us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380528.318306:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 131 00000100:00100000:2.0:1787380528.325862:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380528.325917:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848595840 00000100:00100000:3.0:1787380528.325927:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848595840 00000100:00100000:3.0:1787380528.325990:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 132 00000100:00100000:3.0:1787380528.325999:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+11:15028:x1874203848595840:12345-192.168.206.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787380528.326156:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3624450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+11:15028:x1874203848595840:12345-192.168.206.30@tcp:501:mount.lustre.0 Request processed in 158us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380528.326163:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 132 00000100:00100000:1.0:1787380528.328657:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380528.328731:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848595968 00000100:00100000:3.0:1787380528.328755:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848595968 00000100:00100000:3.0:1787380528.328889:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 133 00000100:00100000:3.0:1787380528.328898:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+11:15028:x1874203848595968:12345-192.168.206.30@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787380528.330193:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3626450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+11:15028:x1874203848595968:12345-192.168.206.30@tcp:503:mount.lustre.0 Request processed in 1288us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380528.330204:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 133 00000100:00100000:1.0:1787380528.343998:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380528.344066:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848596096 00000100:00100000:0.0:1787380528.344076:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848596096 00000100:00100000:0.0:1787380528.344131:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 134 00000100:00100000:0.0:1787380528.344141:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+11:15033:x1874203848596096:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787380528.344292:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3626850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+11:15033:x1874203848596096:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 151us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380528.344301:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 134 00000100:00100000:2.0:1787380528.379372:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380528.379499:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848596224 00000100:00100000:3.0:1787380528.379508:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848596224 00000100:00100000:3.0:1787380528.379564:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 135 00000100:00100000:3.0:1787380528.379573:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+11:15033:x1874203848596224:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787380528.383298:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3625850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+11:15033:x1874203848596224:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 3715us (3924us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380528.383312:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 135 00000100:00100000:1.0:1787380528.387940:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380528.388043:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848596352 00000100:00100000:2.0:1787380528.388052:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848596352 00000100:00100000:2.0:1787380528.388103:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 136 00000100:00100000:2.0:1787380528.388112:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+11:15033:x1874203848596352:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787380528.388244:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3627c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+11:15033:x1874203848596352:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 133us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380528.388252:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 136 00000100:00100000:1.0:1787380528.390890:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380528.390964:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848596480 00000100:00100000:3.0:1787380528.390974:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848596480 00000100:00100000:3.0:1787380528.391030:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 137 00000100:00100000:3.0:1787380528.391039:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+11:15028:x1874203848596480:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787380528.391053:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380528.391068:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89d200/0xcf3c46fdcad6a34d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b0b6 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380528.391091:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89d200/0xcf3c46fdcad6a34d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0b6 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380528.391100:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89d200/0xcf3c46fdcad6a34d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0b6 expref: 12 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380528.391124:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89d200, rc 0) 00000100:00100000:3.0:1787380528.391175:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3627050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+12:15028:x1874203848596480:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 137us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380528.391181:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 137 00000100:00100000:3.0:1787380528.394307:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380528.394424:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848596608 00000100:00100000:0.0:1787380528.394434:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848596608 00000100:00100000:0.0:1787380528.394494:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 138 00000100:00100000:0.0:1787380528.394503:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+12:15028:x1874203848596608:12345-192.168.206.30@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787380528.394529:0:17192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787380528.394558:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787380528.394562:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787380528.394565:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787380528.394568:0:17192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787380528.394571:0:17192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1787380528.397650:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3624c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+12:15028:x1874203848596608:12345-192.168.206.30@tcp:256:mount.lustre.0 Request processed in 3138us (3340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380528.397664:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 138 00000100:00100000:2.0:1787380528.400443:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380528.400512:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848596736 00000100:00100000:3.0:1787380528.400520:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848596736 00000100:00100000:3.0:1787380528.400572:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 139 00000100:00100000:3.0:1787380528.400582:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+12:15028:x1874203848596736:12345-192.168.206.30@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787380528.400598:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380528.400615:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a354 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b0bd expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380528.400641:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0bd expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380528.400652:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0bd expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380528.400661:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89ca00, rc 0) 00000100:00100000:3.0:1787380528.401219:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3627450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:15028:x1874203848596736:12345-192.168.206.30@tcp:101:mount.lustre.0 Request processed in 635us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380528.401227:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 139 00000100:00100000:2.0:1787380528.403259:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380528.403330:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848596864 00000100:00100000:3.0:1787380528.403339:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848596864 00000100:00100000:3.0:1787380528.403394:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 140 00000100:00100000:3.0:1787380528.403649:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:15028:x1874203848596864:12345-192.168.206.30@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787380528.403792:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff638450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:15028:x1874203848596864:12345-192.168.206.30@tcp:501:mount.lustre.0 Request processed in 146us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380528.405700:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 140 00000100:00100000:1.0:1787380528.405887:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380528.405975:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848596992 00000100:00100000:3.0:1787380528.405983:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848596992 00000100:00100000:3.0:1787380528.406061:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 141 00000100:00100000:3.0:1787380528.406071:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:15028:x1874203848596992:12345-192.168.206.30@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787380528.406244:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff639050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:15028:x1874203848596992:12345-192.168.206.30@tcp:503:mount.lustre.0 Request processed in 174us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380528.406253:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 141 00000100:00100000:0.0:1787380528.409247:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380528.409329:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848597120 00000100:00100000:3.0:1787380528.409339:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848597120 00000100:00100000:3.0:1787380528.409594:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 142 00000100:00100000:3.0:1787380528.409605:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:15038:x1874203848597120:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787380528.409750:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff639850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:15038:x1874203848597120:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 147us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380528.409758:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 142 00000100:00100000:2.0:1787380528.419772:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380528.419929:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848597248 00000100:00100000:3.0:1787380528.419939:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848597248 00000100:00100000:3.0:1787380528.419998:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 143 00000100:00100000:3.0:1787380528.420017:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:15038:x1874203848597248:12345-192.168.206.30@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787380528.420157:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff638850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:15038:x1874203848597248:12345-192.168.206.30@tcp:502:llog_process_th.0 Request processed in 151us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380528.420175:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 143 00000100:00100000:2.0:1787380528.423070:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380528.423277:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848597376 00000100:00100000:0.0:1787380528.423289:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848597376 00000100:00100000:0.0:1787380528.423331:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:0.0:1787380528.423338:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2396:x1874203848597376:12345-192.168.206.30@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787380528.423366:0:17199:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from fb3c303c-174e-4b74-a8fe-d1e7ede1cc83@192.168.206.30@tcp t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:0.0:1787380528.423397:0:17199:0:(genops.c:1406:class_connect()) connect: client fb3c303c-174e-4b74-a8fe-d1e7ede1cc83, cookie 0xcf3c46fdcad6a35b 00000004:00100000:0.0:1787380528.423420:0:17199:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787380528.423513:0:17199:0:(import.c:65:import_set_state_nolock()) ffff9d6ec2055000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787380528.423581:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:2396:x1874203848597376:12345-192.168.206.30@tcp:38:mount.lustre.0 Request processed in 240us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380528.423588:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:0.0:1787380528.428334:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380528.428494:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848597632 00000100:00100000:2.0:1787380528.428505:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848597632 00000100:00100000:2.0:1787380528.428558:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:2.0:1787380528.428566:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2396:x1874203848597632:12345-192.168.206.30@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787380528.428597:0:17200:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0001: connection from fb3c303c-174e-4b74-a8fe-d1e7ede1cc83@192.168.206.30@tcp t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:2.0:1787380528.428653:0:17200:0:(genops.c:1406:class_connect()) connect: client fb3c303c-174e-4b74-a8fe-d1e7ede1cc83, cookie 0xcf3c46fdcad6a362 00000004:00100000:2.0:1787380528.428678:0:17200:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787380528.428973:0:17200:0:(import.c:65:import_set_state_nolock()) ffff9d6ec30fd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787380528.429064:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:2396:x1874203848597632:12345-192.168.206.30@tcp:38:mount.lustre.0 Request processed in 497us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380528.429073:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:2.0:1787380528.430662:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380528.430699:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380528.433597:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848597504 00000100:00100000:3.0:1787380528.433611:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848597504 00000100:00080000:1.0:1787380528.435227:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787380528.435286:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848597888 00000100:00100000:3.0:1787380528.435295:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848597888 00000100:00100000:0.0:1787380528.435366:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:0.0:1787380528.435380:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+7:0:x1874203848597504:12345-192.168.206.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787380528.435549:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787380528.435629:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+7:0:x1874203848597504:12345-192.168.206.30@tcp:41:mount.lustre.0 Request processed in 252us (4970us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380528.439973:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:0.0:1787380528.440020:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:0.0:1787380528.440035:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc43eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:15028:x1874203848597888:12345-192.168.206.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787380528.440067:0:17199:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787380528.440137:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc43eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:15028:x1874203848597888:12345-192.168.206.30@tcp:41:mount.lustre.0 Request processed in 108us (9436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380528.440144:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:0.0:1787380528.440204:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380528.440227:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848597760 00000100:00100000:0.0:1787380528.440234:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848597760 00000100:00100000:0.0:1787380528.440276:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:0.0:1787380528.440283:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:0:x1874203848597760:12345-192.168.206.30@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787380528.440309:0:17200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787380528.440360:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:0:x1874203848597760:12345-192.168.206.30@tcp:41:mount.lustre.0 Request processed in 77us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380528.440367:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00080000:1.0:1787380528.441086:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787380528.443058:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380528.443198:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848598016 00000100:00100000:0.0:1787380528.443206:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848598016 00000100:00100000:0.0:1787380528.443259:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:0.0:1787380528.443267:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:15028:x1874203848598016:12345-192.168.206.30@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787380528.443429:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:15028:x1874203848598016:12345-192.168.206.30@tcp:40:mount.lustre.0 Request processed in 161us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380528.443440:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:2.0:1787380528.446165:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380528.446204:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380528.446235:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380528.446426:0:17210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848598400 00000100:00100000:0.0:1787380528.446445:0:17210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848598400 00000100:00100000:0.0:1787380528.446508:0:17210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:0.0:1787380528.446518:0:17210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:15028:x1874203848598400:12345-192.168.206.30@tcp:900:mount.lustre.0 00000100:00100000:0.0:1787380528.446590:0:17210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:15028:x1874203848598400:12345-192.168.206.30@tcp:900:mount.lustre.0 Request processed in 73us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380528.446598:0:17210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:1.0:1787380528.446744:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848598144 00000100:00100000:1.0:1787380528.446749:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848598144 00000100:00100000:1.0:1787380528.446984:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848598272 00000100:00100000:1.0:1787380528.446989:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848598272 00000100:00100000:1.0:1787380528.447020:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:1.0:1787380528.447025:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2396:x1874203848598144:12345-192.168.206.30@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787380528.447051:0:18704:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from fb3c303c-174e-4b74-a8fe-d1e7ede1cc83@192.168.206.30@tcp t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:1.0:1787380528.447078:0:18704:0:(genops.c:1406:class_connect()) connect: client fb3c303c-174e-4b74-a8fe-d1e7ede1cc83, cookie 0xcf3c46fdcad6a369 00002000:00100000:1.0:1787380528.447089:0:18704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fb3c303c-174e-4b74-a8fe-d1e7ede1cc83/ffff9d6ec3f4b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787380528.447099:0:18704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787380528.447169:0:18704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787380528.447193:0:18704:0:(import.c:65:import_set_state_nolock()) ffff9d6ec3f48000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787380528.447228:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:2396:x1874203848598144:12345-192.168.206.30@tcp:8:mount.lustre.0 Request processed in 202us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380528.447235:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:3.0:1787380528.447245:0:19599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:3.0:1787380528.447250:0:19599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2396:x1874203848598272:12345-192.168.206.30@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787380528.447267:0:19599:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from fb3c303c-174e-4b74-a8fe-d1e7ede1cc83@192.168.206.30@tcp t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:3.0:1787380528.447285:0:19599:0:(genops.c:1406:class_connect()) connect: client fb3c303c-174e-4b74-a8fe-d1e7ede1cc83, cookie 0xcf3c46fdcad6a370 00002000:00100000:3.0:1787380528.447291:0:19599:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fb3c303c-174e-4b74-a8fe-d1e7ede1cc83/ffff9d6ec231a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113674 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787380528.447365:0:19599:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787380528.447410:0:19599:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787380528.447426:0:19599:0:(import.c:65:import_set_state_nolock()) ffff9d6ec231b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787380528.447608:0:19599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:2396:x1874203848598272:12345-192.168.206.30@tcp:8:mount.lustre.0 Request processed in 199us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380528.447615:0:19599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:1.0:1787380528.450692:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380528.450905:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848598528 00000100:00100000:2.0:1787380528.450914:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848598528 00000100:00100000:2.0:1787380528.451002:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00100000:2.0:1787380528.451020:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:15028:x1874203848598528:12345-192.168.206.30@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787380528.451098:0:17203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787380528.451175:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:15028:x1874203848598528:12345-192.168.206.30@tcp:33:mount.lustre.0 Request processed in 165us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380528.451183:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00100000:0.0:1787380528.645749:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380528.645899:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848598656 00000100:00100000:1.0:1787380528.645908:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848598656 00000100:00100000:1.0:1787380528.646018:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00100000:1.0:1787380528.646027:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:15061:x1874203848598656:12345-192.168.206.30@tcp:101:mkdir.0 00010000:00010000:1.0:1787380528.646046:0:19900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380528.646067:0:19900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad6a377 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b0ee expref: -99 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380528.646128:0:19900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a37e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380528.646141:0:19900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a37e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380528.646151:0:19900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a37e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380528.646193:0:19900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787380528.646197:0:19900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787380528.646214:0:19900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a37e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380528.646238:0:19900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad6a377 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0ee expref: 8 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380528.646255:0:19900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a37e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0ee expref: 7 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380528.646263:0:19900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25a9f00) 00010000:00010000:1.0:1787380528.646265:0:19900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787380528.646282:0:19900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df0a00, rc 0) 00000100:00100000:1.0:1787380528.646341:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+7:15061:x1874203848598656:12345-192.168.206.30@tcp:101:mkdir.0 Request processed in 315us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380528.646349:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 22 00010000:00010000:0.0:1787380529.037218:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787380529.294318:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867545472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380529.294383:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380529.294465:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867545472 00000100:00100000:1.0:1787380529.294472:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867545472 00000100:00100000:1.0:1787380529.294522:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787380529.294532:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867545472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787380529.294551:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787380529.294591:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867545472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380529.294598:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787380529.294618:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787380529.294650:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867545472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787380529.295953:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867545728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787380529.295997:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380529.296045:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867545600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787380529.296067:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380529.296092:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867545728 00000100:00100000:1.0:1787380529.296097:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867545728 00000100:00100000:1.0:1787380529.296127:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867545600 00000100:00100000:1.0:1787380529.296129:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867545600 00000100:00100000:1.0:1787380529.296143:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787380529.296150:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867545728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787380529.296179:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787380529.296216:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867545728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380529.296223:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787380529.296238:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787380529.296244:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867545600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787380529.296254:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787380529.296282:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867545600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380529.296288:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787380529.296303:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787380529.296306:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787380529.296329:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867545600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787380529.296353:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867545728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787380529.299700:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3640:1874203867545856:0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.299777:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380529.299831:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867546368:0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.299903:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380529.299926:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1874203867546880:0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.299952:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380529.299972:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787380529.299977:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867546240:0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.299996:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380529.300023:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867546752:0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.300055:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380529.300082:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867545984:0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.300104:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380529.300120:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867546496:0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.300139:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380529.300154:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867547008:0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.300170:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380529.300180:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787380529.300185:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867546112:0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.300203:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380529.300218:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec44bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867546624:0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.300235:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380529.300259:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867546368 00000100:00100000:2.0:1787380529.300265:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867546368 00000100:00100000:2.0:1787380529.300313:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867545984 00000100:00100000:2.0:1787380529.300317:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867545984 00000100:00100000:2.0:1787380529.300332:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787380529.300338:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867546368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.300388:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867546368:12345-0@lo:400:kworker.0 Request processed in 49us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380529.301496:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787380529.301526:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787380529.301536:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867545984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.301603:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867545984:12345-0@lo:400:kworker.0 Request processed in 70us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380529.301609:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787380529.301644:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867546880 00000100:00100000:2.0:1787380529.301650:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867546880 00000100:00100000:2.0:1787380529.301684:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867546240 00000100:00100000:2.0:1787380529.301687:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867546240 00000100:00100000:2.0:1787380529.301698:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867546752 00000100:00100000:2.0:1787380529.301700:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867546752 00000100:00100000:2.0:1787380529.301711:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867546496 00000100:00100000:2.0:1787380529.301713:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867546496 00000100:00100000:2.0:1787380529.301723:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867547008 00000100:00100000:2.0:1787380529.301725:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867547008 00000100:00100000:2.0:1787380529.301736:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867546624 00000100:00100000:2.0:1787380529.301738:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867546624 00000100:00100000:2.0:1787380529.301750:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787380529.301769:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874203867546880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.301800:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874203867546880:12345-0@lo:400:kworker.0 Request processed in 45us (1847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380529.301806:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787380529.301832:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787380529.301837:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867546240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.301861:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1874203867546240:12345-0@lo:400:kworker.0 Request processed in 24us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380529.301997:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787380529.302022:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787380529.302028:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec44bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867546752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.302058:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec44bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867546752:12345-0@lo:400:kworker.0 Request processed in 31us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380529.302065:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787380529.302075:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787380529.302080:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867546496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.302111:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1874203867546496:12345-0@lo:400:kworker.0 Request processed in 31us (1970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380529.302116:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787380529.302127:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787380529.302131:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874203867547008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.302154:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1874203867547008:12345-0@lo:400:kworker.0 Request processed in 22us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380529.302159:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787380529.302167:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787380529.302173:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867546624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.302192:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3641:x1874203867546624:12345-0@lo:400:kworker.0 Request processed in 20us (1957us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380529.302198:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787380529.302216:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867546112 00000100:00100000:2.0:1787380529.302220:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867546112 00000100:00100000:2.0:1787380529.302245:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787380529.302251:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867546112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.302276:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867546112:12345-0@lo:400:kworker.0 Request processed in 26us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380529.302281:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787380529.302297:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787380529.302301:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787380529.302303:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380529.302330:0:3641:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1787380529.302351:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867546112:0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.302363:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3641:1874203867546624:0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.302381:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867545984:0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.302390:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3641:1874203867546496:0@lo:400:kworker.0 00000100:00100000:0.0:1787380529.304118:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867547136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380529.304170:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380529.304214:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867547136 00000100:00100000:0.0:1787380529.304219:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867547136 00000100:00100000:0.0:1787380529.304256:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787380529.304265:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867547136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787380529.304350:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787380529.304391:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867547136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380529.304397:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787380529.304471:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec44be680 x1874203867547008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380529.304489:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3641:1874203867547008:0@lo:400:kworker.0 00000100:00100000:0.0:1787380529.304551:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867547136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787380529.305579:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3640:1874203867546240:0@lo:400:kworker.0 00010000:00080000:2.0:1787380529.305597:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec44bf100 x1874203867546752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380529.305607:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867546752:0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.305619:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867546368:0@lo:400:kworker.0 00000100:00100000:2.0:1787380529.305630:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1874203867546880:0@lo:400:kworker.0 00000100:00100000:3.0:1787380529.305672:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867545856 00000100:00100000:3.0:1787380529.305680:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867545856 00000100:00100000:3.0:1787380529.305723:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787380529.305731:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff63a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:3640:x1874203867545856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380529.305820:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff63a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:3640:x1874203867545856:12345-0@lo:400:kworker.0 Request processed in 76us (6030us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380529.305827:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787380529.305851:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec44bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3640:1874203867545856:0@lo:400:kworker.0 00000100:00100000:0.0:1787380529.808787:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787380529.808823:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867547264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787380529.808885:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380529.809046:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867547264 00000100:00100000:2.0:1787380529.809055:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867547264 00000100:00100000:2.0:1787380529.809154:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787380529.809164:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867547264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787380529.809195:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1787380529.809245:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867547264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380529.809252:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787380529.809365:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867547264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787380529.810160:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380529.810171:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867547392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787380529.810216:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380529.810287:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867547392 00000100:00100000:2.0:1787380529.810293:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867547392 00000100:00100000:2.0:1787380529.810337:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787380529.810345:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867547392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787380529.810368:0:17939:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787380529.810401:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1874203867547392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380529.810417:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787380529.810485:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3639:1874203867547392:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1787380530.060554:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787380530.766012:0:17958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787380531.091156:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787380531.242163:0:20079:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1787380531.866507:0:19519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fb3c303c-174e-4b74-a8fe-d1e7ede1cc83 00000001:00100000:2.0:1787380531.866519:0:19519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 864e2bc1-2781-452d-8411-8f2a646f656c 00000001:00100000:3.0:1787380531.868460:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fb3c303c-174e-4b74-a8fe-d1e7ede1cc83 00000001:00100000:3.0:1787380531.868471:0:18701:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 864e2bc1-2781-452d-8411-8f2a646f656c 00000001:00100000:2.0:1787380531.869267:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fb3c303c-174e-4b74-a8fe-d1e7ede1cc83 00000001:00100000:2.0:1787380531.869275:0:17179:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 864e2bc1-2781-452d-8411-8f2a646f656c 00000001:00100000:0.0:1787380531.876353:0:17931:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fb3c303c-174e-4b74-a8fe-d1e7ede1cc83 00000001:00100000:0.0:1787380531.876365:0:17931:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 864e2bc1-2781-452d-8411-8f2a646f656c 00010000:00010000:3.0:1787380532.108687:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787380533.135435:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380533.919212:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380533.919253:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380533.919283:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380533.919298:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380533.919312:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380533.919327:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380533.919340:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380533.919354:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380533.919370:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380533.919392:0:19599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848599168 00000100:00100000:3.0:1787380533.919399:0:19599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848599168 00000100:00100000:3.0:1787380533.919441:0:19599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848599680 00000100:00100000:3.0:1787380533.919444:0:19599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848599680 00000100:00100000:3.0:1787380533.919462:0:19599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848599296 00000100:00100000:3.0:1787380533.919464:0:19599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848599296 00000100:00100000:3.0:1787380533.919475:0:19599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848599808 00000100:00100000:3.0:1787380533.919477:0:19599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848599808 00000100:00100000:3.0:1787380533.919489:0:19599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:3.0:1787380533.919497:0:19599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:864e2bc1-2781-452d-8411-8f2a646f656c+5:2398:x1874203848599168:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380533.919559:0:19599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:864e2bc1-2781-452d-8411-8f2a646f656c+5:2398:x1874203848599168:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 63us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380533.919580:0:19599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:3.0:1787380533.919595:0:19599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:3.0:1787380533.919601:0:19599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+5:2398:x1874203848599680:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380533.919624:0:19599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+5:2398:x1874203848599680:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 23us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380533.919629:0:19599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:3.0:1787380533.919639:0:19599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:3.0:1787380533.919645:0:19599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:864e2bc1-2781-452d-8411-8f2a646f656c+5:2397:x1874203848599296:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380533.919664:0:19599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:864e2bc1-2781-452d-8411-8f2a646f656c+5:2397:x1874203848599296:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 20us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380533.919669:0:19599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:3.0:1787380533.919678:0:19599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:3.0:1787380533.919683:0:19599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+5:2397:x1874203848599808:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380533.919699:0:19599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+5:2397:x1874203848599808:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 16us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380533.919704:0:19599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00080000:3.0:1787380533.919719:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787380533.919722:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380533.919776:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848598912 00000100:00100000:0.0:1787380533.919780:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848598912 00000100:00100000:0.0:1787380533.919835:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848599424 00000100:00100000:0.0:1787380533.919838:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848599424 00000100:00100000:0.0:1787380533.919853:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848599040 00000100:00100000:0.0:1787380533.919855:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848599040 00000100:00100000:0.0:1787380533.919866:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848599552 00000100:00100000:0.0:1787380533.919868:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848599552 00000100:00100000:0.0:1787380533.919881:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 41 00000100:00100000:0.0:1787380533.919887:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+6:2398:x1874203848598912:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380533.919915:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+6:2398:x1874203848598912:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 28us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380533.919921:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 41 00000100:00100000:0.0:1787380533.919934:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00100000:0.0:1787380533.919941:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:2398:x1874203848599424:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380533.919987:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:2398:x1874203848599424:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 37us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380533.919993:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00100000:0.0:1787380533.920005:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 43 00000100:00100000:0.0:1787380533.920012:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+5:2397:x1874203848599040:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380533.920034:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+5:2397:x1874203848599040:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 23us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380533.920040:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 43 00000100:00100000:0.0:1787380533.920049:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 44 00000100:00100000:0.0:1787380533.920054:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+5:2397:x1874203848599552:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380533.920071:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+5:2397:x1874203848599552:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 17us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380533.920082:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 44 00000100:00100000:0.0:1787380533.920235:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848598784 00000100:00100000:0.0:1787380533.920239:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848598784 00000100:00100000:0.0:1787380533.920261:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 145 00000100:00100000:0.0:1787380533.920266:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff63ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:2397:x1874203848598784:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380533.920290:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff63ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:2397:x1874203848598784:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 24us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380533.920296:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 145 00000100:00080000:3.0:1787380533.922246:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787380533.922255:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787380534.156764:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787380534.381318:0:20227:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fffd10e7a80 00000020:00000080:2.0:1787380534.381331:0:20227:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787380534.381335:0:20227:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787380534.381341:0:20227:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd10e9d10 20000000:00000080:2.0:1787380534.381346:0:20227:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9d6ec27b9800 uarg=0000000000000000 20000000:01000000:2.0:1787380534.381492:0:20227:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787380534.381498:0:20227:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787380534.381502:0:20227:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787380534.382524:0:20228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1787380534.382665:0:20227:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787380534.391115:0:20227:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787380534.391632:0:20227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9d6ff5d47200/0xcf3c46fdcad6a385 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380534.391651:0:20227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ec3df0000/0xcf3c46fdcad6a01a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a013 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380534.391659:0:20227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad6a028 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a021 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380534.391679:0:20227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ec3df1000/0xcf3c46fdcad6a067 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a060 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380534.391687:0:20227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ec3df0800/0xcf3c46fdcad6a101 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a0fa expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380534.391696:0:20227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a315 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b04d expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380534.391703:0:20227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a354 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0bd expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380534.391711:0:20227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9d6ff5d47200/0xcf3c46fdcad6a385 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380534.391761:0:20227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a354 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0bd expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380534.391776:0:20227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a354 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0bd expref: 12 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380534.391789:0:20227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c9b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874203867547520:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380534.393186:0:20227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b04d expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380534.393200:0:20227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a315 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b04d expref: 12 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380534.393213:0:20227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c9aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874203867547648:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380534.393291:0:20227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ec3df0800/0xcf3c46fdcad6a101 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad6a0fa expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380534.393299:0:20227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6ec3df0800/0xcf3c46fdcad6a101 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a0fa expref: 23 pid: 17194 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380534.393308:0:20227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c9b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874203867547776:0@lo:104: 00000100:00100000:2.0:1787380534.393337:0:20227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380534.393363:0:20227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ec3df1000/0xcf3c46fdcad6a067 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad6a060 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380534.393370:0:20227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6ec3df1000/0xcf3c46fdcad6a067 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a060 expref: 23 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380534.393378:0:20227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c98700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874203867547904:0@lo:104: 00000100:00100000:2.0:1787380534.393409:0:20227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380534.393432:0:20227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad6a028 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad6a021 expref: 23 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380534.393441:0:20227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad6a028 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a021 expref: 23 pid: 17194 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380534.393449:0:20227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c9ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874203867548032:0@lo:104: 00000100:00100000:2.0:1787380534.393469:0:20227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787380534.393487:0:20227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9d6ec3df0000/0xcf3c46fdcad6a01a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcf3c46fdcad6a013 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380534.393495:0:20227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9d6ec3df0000/0xcf3c46fdcad6a01a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a013 expref: 23 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380534.393514:0:20227:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c9a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874203867548160:0@lo:104: 00000100:00100000:2.0:1787380534.393536:0:20227:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380534.393549:0:20227:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feeb88e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787380534.393683:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867547776 00000100:00100000:3.0:1787380534.393697:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867547776 00000100:00100000:3.0:1787380534.393744:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867547904 00000100:00100000:3.0:1787380534.393747:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867547904 00000100:00100000:3.0:1787380534.393758:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867548032 00000100:00100000:3.0:1787380534.393763:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867548032 00000100:00100000:3.0:1787380534.393771:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867548160 00000100:00100000:3.0:1787380534.393773:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867548160 00000100:00100000:3.0:1787380534.393783:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787380534.393790:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+6:20227:x1874203867547776:12345-0@lo:104: 00010000:00010000:3.0:1787380534.393801:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad6a0fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad6a101 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380534.393882:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787380534.394016:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+6:20227:x1874203867547776:12345-0@lo:104: Request processed in 98us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380534.394025:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787380534.394042:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787380534.394049:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+5:20227:x1874203867547904:12345-0@lo:104: 00010000:00010000:3.0:1787380534.394057:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad6a060 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad6a067 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380534.394099:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787380534.394104:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c99880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+5:20227:x1874203867547904:12345-0@lo:104: Request processed in 57us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380534.394110:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787380534.394122:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787380534.394129:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+4:20227:x1874203867548032:12345-0@lo:104: 00010000:00010000:3.0:1787380534.394136:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e800/0xcf3c46fdcad6a021 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad6a028 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380534.394179:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787380534.394185:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+4:20227:x1874203867548032:12345-0@lo:104: Request processed in 57us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380534.394192:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787380534.394210:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787380534.394216:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+3:20227:x1874203867548160:12345-0@lo:104: 00010000:00010000:3.0:1787380534.394225:0:17182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866200/0xcf3c46fdcad6a013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad6a01a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380534.394251:0:17182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1787380534.394256:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+3:20227:x1874203867548160:12345-0@lo:104: Request processed in 41us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380534.394262:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787380534.394269:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787380534.394278:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad6a0fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad6a101 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380534.394280:0:17187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787380534.394290:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c400 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:0.0:1787380534.394295:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad6a0fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad6a101 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.394304:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad6a0fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad6a101 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380534.394311:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad6a0fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad6a101 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380534.394316:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787380534.394348:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad6a0fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad6a101 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.394354:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787380534.394378:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad6a0fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad6a101 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.394393:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89c400/0xcf3c46fdcad6a0fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad6a101 expref: -99 pid: 19518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.394406:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787380534.394409:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e800/0xcf3c46fdcad6a021 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad6a028 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.394416:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fd0d0e800 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:0.0:1787380534.394420:0:17188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e800/0xcf3c46fdcad6a021 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad6a028 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.394427:0:17188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e800/0xcf3c46fdcad6a021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad6a028 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787380534.394433:0:17188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e800/0xcf3c46fdcad6a021 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad6a028 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380534.394438:0:17188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787380534.394454:0:20229:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380534.394454:0:17188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e800/0xcf3c46fdcad6a021 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad6a028 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.394463:0:17188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380534.394465:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad6a060 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad6a067 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.394471:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e800/0xcf3c46fdcad6a021 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad6a028 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380534.394474:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89cc00 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380534.394480:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad6a060 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad6a067 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.394483:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fd0d0e800/0xcf3c46fdcad6a021 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad6a028 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380534.394498:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad6a060 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad6a067 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.394502:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1787380534.394507:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad6a060 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad6a067 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.394512:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380534.394515:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787380534.394528:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1787380534.394535:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867548288:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787380534.394555:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad6a060 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad6a067 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380534.394563:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787380534.394573:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787380534.394580:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad6a060 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad6a067 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380534.394588:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89cc00/0xcf3c46fdcad6a060 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad6a067 expref: -99 pid: 18700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380534.394599:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380534.394602:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1787380534.394603:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380534.394606:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380534.394612:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867548416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380534.394619:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3639:1874203867548544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380534.394638:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380534.394658:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380534.394683:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867548288 00000100:00100000:0.0:1787380534.394688:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867548288 00010000:00010000:0.0:1787380534.394710:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ec3df0800/0xcf3c46fdcad6a101 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a0fa expref: 24 pid: 17194 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380534.394732:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867548416 00000100:00100000:0.0:1787380534.394735:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867548416 00010000:00010000:0.0:1787380534.394747:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad6a028 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a021 expref: 25 pid: 17194 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380534.394762:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867548544 00000100:00100000:0.0:1787380534.394765:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867548544 00010000:00010000:0.0:1787380534.394775:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ec3df1000/0xcf3c46fdcad6a067 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a060 expref: 26 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380534.394786:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787380534.394793:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+26:3641:x1874203867548288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787380534.394801:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380534.394806:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ec3df0800/0xcf3c46fdcad6a101 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a0fa expref: 26 pid: 17194 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.394839:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ec3df0800/0xcf3c46fdcad6a101 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a0fa expref: 26 pid: 17194 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.394867:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380534.394899:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+26:3641:x1874203867548288:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.394907:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787380534.394921:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787380534.394927:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+25:3641:x1874203867548416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787380534.394935:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380534.394940:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad6a028 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a021 expref: 25 pid: 17194 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.394948:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad6a028 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a021 expref: 25 pid: 17194 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.394957:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380534.394991:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+25:3641:x1874203867548416:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.394999:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787380534.395015:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787380534.395022:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:3639:x1874203867548544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787380534.395029:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380534.395034:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ec3df1000/0xcf3c46fdcad6a067 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a060 expref: 24 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.395042:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ec3df1000/0xcf3c46fdcad6a067 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a060 expref: 24 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.395051:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380534.395089:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:3639:x1874203867548544:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.395096:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787380534.395139:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867548416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787380534.395149:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3641:1874203867548288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787380534.395283:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3639:1874203867548544:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787380534.397207:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380534.397212:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787380534.397214:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380534.397254:0:20229:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866200/0xcf3c46fdcad6a013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcf3c46fdcad6a01a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380534.397265:0:20229:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866200 already unused, calling callback (ffffffffc13abc20) 10000000:00010000:3.0:1787380534.397269:0:20229:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866200/0xcf3c46fdcad6a013 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcf3c46fdcad6a01a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380534.397279:0:20229:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866200/0xcf3c46fdcad6a013 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcf3c46fdcad6a01a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787380534.397286:0:20229:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866200/0xcf3c46fdcad6a013 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcf3c46fdcad6a01a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380534.397308:0:20229:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787380534.397354:0:20229:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866200/0xcf3c46fdcad6a013 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad6a01a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380534.397361:0:20229:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787380534.397391:0:20229:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866200/0xcf3c46fdcad6a013 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad6a01a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380534.397398:0:20229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.130@tcp lock: ffff9d6fe7866200/0xcf3c46fdcad6a013 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcf3c46fdcad6a01a expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380534.397420:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787380534.397433:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3639:1874203867548672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787380534.397484:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787380534.397521:0:20229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380534.397524:0:20229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380534.397525:0:20229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787380534.397885:0:20227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ec3df0800/0xcf3c46fdcad6a101 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad6a0fa expref: 23 pid: 17194 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380534.397910:0:20227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c9b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874203867547776:0@lo:104: 00010000:00010000:3.0:1787380534.397922:0:20227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ec3df1000/0xcf3c46fdcad6a067 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad6a060 expref: 22 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380534.397929:0:20227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c98700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874203867547904:0@lo:104: 00010000:00010000:3.0:1787380534.397938:0:20227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6fe7867000/0xcf3c46fdcad6a028 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad6a021 expref: 21 pid: 17194 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380534.397946:0:20227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c9ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874203867548032:0@lo:104: 00000100:00100000:3.0:1787380534.397963:0:20227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c9a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874203867548160:0@lo:104: 00000100:00100000:0.0:1787380534.398175:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380534.398256:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380534.398281:0:19536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867548672 00000100:00100000:0.0:1787380534.398288:0:19536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867548672 00010000:00010000:0.0:1787380534.398312:0:19536:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ec3df0000/0xcf3c46fdcad6a01a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a013 expref: 21 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380534.398336:0:19536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848599936 00000100:00100000:0.0:1787380534.398339:0:19536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848599936 00010000:00010000:0.0:1787380534.398351:0:19536:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a354 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0bd expref: 13 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380534.398361:0:19536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848600064 00000100:00100000:0.0:1787380534.398364:0:19536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848600064 00010000:00010000:0.0:1787380534.398373:0:19536:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a315 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b04d expref: 14 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380534.398397:0:19536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787380534.398406:0:19536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:3639:x1874203867548672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787380534.398417:0:19536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380534.398422:0:19536:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ec3df0000/0xcf3c46fdcad6a01a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a013 expref: 21 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.398431:0:19536:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ec3df0000/0xcf3c46fdcad6a01a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcf3c46fdcad6a013 expref: 21 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.398452:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ec3df0000/0xcf3c46fdcad6a01a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcf3c46fdcad6a013 expref: 21 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.398463:0:19536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380534.398498:0:19536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7d8d387d-7e15-4118-9d7b-f7697dc8c103+20:3639:x1874203867548672:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.398505:0:19536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787380534.398521:0:19536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:0.0:1787380534.398527:0:19536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef75c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+14:2399:x1874203848599936:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380534.398534:0:19536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380534.398539:0:19536:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a354 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0bd expref: 14 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.398550:0:19536:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a354 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0bd expref: 14 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.398560:0:19536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380534.398593:0:19536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef75c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+14:2399:x1874203848599936:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 66us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.398599:0:19536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 13 00000100:00100000:0.0:1787380534.398632:0:19536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:0.0:1787380534.398638:0:19536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:2400:x1874203848600064:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380534.398645:0:19536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380534.398649:0:19536:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a315 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b04d expref: 13 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.398668:0:19536:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a315 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b04d expref: 13 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.398679:0:19536:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9d6ff5d47200/0xcf3c46fdcad6a385 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.398686:0:19536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ff5d47200/0xcf3c46fdcad6a385 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.398700:0:19536:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6ff5d47200/0xcf3c46fdcad6a385 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.398707:0:19536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9d6ff5d47200/0xcf3c46fdcad6a385 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.398712:0:19536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9d6ff5d47200/0xcf3c46fdcad6a385 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.398719:0:19536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9d6ff5d47200/0xcf3c46fdcad6a385 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.398730:0:19536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47200 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380534.398735:0:19536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9d6ff5d47200/0xcf3c46fdcad6a385 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.398743:0:19536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9d6ff5d47200/0xcf3c46fdcad6a385 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.398751:0:19536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9d6ff5d47200/0xcf3c46fdcad6a385 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380534.398768:0:19536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380534.398787:0:19536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:2400:x1874203848600064:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 149us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.398794:0:19536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 14 00000100:00100000:0.0:1787380534.398919:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3639:1874203867548672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787380534.399365:0:20227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a354 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0bd expref: 12 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380534.399376:0:20227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c9b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874203867547520:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380534.399403:0:20227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a315 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b04d expref: 11 pid: 17193 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380534.399412:0:20227:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c9aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20227:1874203867547648:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380534.399436:0:20227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9d6ff5d47200/0xcf3c46fdcad6a385 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380534.399445:0:20227:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9d6ff5d47200/0xcf3c46fdcad6a385 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380534.399451:0:20227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9d6ff5d47200/0xcf3c46fdcad6a385 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380534.399457:0:20227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9d6ff5d47200/0xcf3c46fdcad6a385 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380534.413291:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867548800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380534.413359:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380534.413405:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787380534.413413:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867548928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787380534.413440:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380534.415696:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867548800 00000100:00100000:0.0:1787380534.415705:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867548800 00000100:00100000:0.0:1787380534.415753:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867548928 00000100:00100000:0.0:1787380534.415756:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867548928 00000100:00100000:0.0:1787380534.415776:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787380534.415785:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867548800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787380534.415825:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787380534.415891:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1874203867548800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (2531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.415898:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787380534.415914:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787380534.415920:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867548928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787380534.415929:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787380534.415954:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867548928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (2514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.415961:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1787380534.415995:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787380534.416008:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867549440:0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.416041:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380534.416063:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1874203867549952:0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.416094:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380534.416114:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787380534.416120:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867549312:0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.416142:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380534.416161:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867549824:0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.416180:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380534.416194:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867550336:0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.416211:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380534.416233:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867549440 00000100:00100000:0.0:1787380534.416236:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867549440 00000100:00100000:0.0:1787380534.416254:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867549952 00000100:00100000:0.0:1787380534.416256:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867549952 00000100:00100000:0.0:1787380534.416269:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867549824 00000100:00100000:0.0:1787380534.416271:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867549824 00000100:00100000:0.0:1787380534.416279:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867550336 00000100:00100000:0.0:1787380534.416280:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867550336 00000100:00100000:0.0:1787380534.416291:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787380534.416296:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867549440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.416328:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3d79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3642:x1874203867549440:12345-0@lo:400:kworker.0 Request processed in 32us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.416334:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787380534.416345:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787380534.416350:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874203867549952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.416375:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3642:x1874203867549952:12345-0@lo:400:kworker.0 Request processed in 25us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.416388:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787380534.416399:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787380534.416413:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867549824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.416441:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3642:x1874203867549824:12345-0@lo:400:kworker.0 Request processed in 30us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.416447:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787380534.416460:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787380534.416466:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867550336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.416488:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3642:x1874203867550336:12345-0@lo:400:kworker.0 Request processed in 23us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.416494:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787380534.416514:0:19599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867549312 00000100:00100000:0.0:1787380534.416518:0:19599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867549312 00000100:00100000:0.0:1787380534.416542:0:19599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787380534.416549:0:19599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867549312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.416576:0:19599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867549312:12345-0@lo:400:kworker.0 Request processed in 28us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.416582:0:19599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787380534.416600:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380534.416604:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787380534.416606:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787380534.416633:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867549312:0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.416642:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3642:1874203867549824:0@lo:400:kworker.0 00010000:00080000:0.0:1787380534.416652:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6ec3cb0700 x1874203867550336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380534.416661:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3cb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3642:1874203867550336:0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.416670:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3642:1874203867549440:0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.416688:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3642:1874203867549952:0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.416716:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867549184:0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.416741:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380534.416761:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867549696:0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.416779:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380534.416795:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1874203867550208:0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.416834:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380534.416849:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1787380534.416855:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867549056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380534.416875:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380534.416890:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867549568:0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.416909:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380534.416926:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867550080:0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.416944:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380534.416967:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867549184 00000100:00100000:0.0:1787380534.416972:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867549184 00000100:00100000:0.0:1787380534.417007:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867549568 00000100:00100000:0.0:1787380534.417010:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867549568 00000100:00100000:0.0:1787380534.417021:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787380534.417026:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867549184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.417061:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867549184:12345-0@lo:400:kworker.0 Request processed in 34us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.417067:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787380534.417079:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787380534.417085:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867549568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.417121:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867549568:12345-0@lo:400:kworker.0 Request processed in 36us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.417611:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787380534.417633:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867549696 00000100:00100000:0.0:1787380534.417637:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867549696 00000100:00100000:0.0:1787380534.417680:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787380534.417687:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867549696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.417719:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867549696:12345-0@lo:400:kworker.0 Request processed in 34us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.417725:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787380534.417740:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867550208 00000100:00100000:0.0:1787380534.417744:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867550208 00000100:00100000:0.0:1787380534.417764:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867550080 00000100:00100000:0.0:1787380534.417767:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867550080 00000100:00100000:0.0:1787380534.417783:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787380534.417790:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874203867550208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.417843:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1874203867550208:12345-0@lo:400:kworker.0 Request processed in 54us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.417849:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787380534.417861:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787380534.417867:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867550080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.417893:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1874203867550080:12345-0@lo:400:kworker.0 Request processed in 28us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.417900:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787380534.417918:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867549056 00000100:00100000:0.0:1787380534.417921:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867549056 00000100:00100000:0.0:1787380534.417940:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787380534.417954:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867549056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787380534.417973:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787380534.418016:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867549056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.418021:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787380534.418070:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867549056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380534.418083:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867549568:0@lo:400:kworker.0 00010000:00080000:0.0:1787380534.418093:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc30da680 x1874203867550080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787380534.418101:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3640:1874203867550080:0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.418110:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867549184:0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.418116:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867549696:0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.418123:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3640:1874203867550208:0@lo:400:kworker.0 00000100:00100000:0.0:1787380534.418182:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867548928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787380534.418196:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3641:1874203867548800:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787380534.418270:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787380534.418273:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787380534.418281:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787380534.422054:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867550464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380534.422116:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380534.422700:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867550464 00000100:00100000:1.0:1787380534.422709:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867550464 00000100:00100000:1.0:1787380534.422766:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787380534.422775:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867550464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380534.422797:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787380534.422874:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867550464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380534.422891:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787380534.422909:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867550464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787380534.924760:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380534.924782:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867550592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787380534.924879:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380534.925541:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867550592 00000100:00100000:3.0:1787380534.925550:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867550592 00000100:00100000:3.0:1787380534.925593:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787380534.925601:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867550592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787380534.925631:0:17205:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787380534.925683:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867550592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380534.925690:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787380534.925733:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867550592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787380534.928523:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787380534.928544:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867550720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787380534.928603:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380534.928680:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867550720 00000100:00100000:0.0:1787380534.928688:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867550720 00000100:00100000:0.0:1787380534.928794:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787380534.928804:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867550720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787380534.928877:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1787380534.928919:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867550720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380534.928925:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787380534.929089:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867550720:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787380535.180061:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787380535.501413:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787380535.501421:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ec10c4800 from 13 10000000:01000000:3.0:1787380535.501425:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787380535.501465:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a38c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380535.501477:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a38c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380535.501487:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a38c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380535.501511:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867550848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787380535.501571:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380535.501613:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff88e2180 going to sleep for 11 seconds 00000100:00100000:0.0:1787380535.501682:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867550848 00000100:00100000:0.0:1787380535.501689:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867550848 00000100:00100000:0.0:1787380535.502047:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787380535.502058:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+20:17196:x1874203867550848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380535.502071:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380535.502083:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9a800/0xcf3c46fdcad6a393 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6a38c expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380535.502107:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9a800/0xcf3c46fdcad6a393 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a38c expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380535.502118:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9a800/0xcf3c46fdcad6a393 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a38c expref: 21 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380535.502125:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9a800, rc 0) 00000100:00100000:0.0:1787380535.502166:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff638c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:17196:x1874203867550848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380535.502172:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787380535.502398:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867550848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380535.502412:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a38c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a393 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380535.502433:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a38c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad6a393 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380535.502502:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867550976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380535.502535:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380535.502571:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff88e2180 going to sleep for 11 seconds 00000100:00100000:1.0:1787380535.503980:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867550976 00000100:00100000:1.0:1787380535.503991:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867550976 00000100:00100000:1.0:1787380535.504044:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787380535.504053:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff63a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:17196:x1874203867550976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380535.504308:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff63a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:17196:x1874203867550976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380535.504316:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787380535.504472:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867550976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380535.504513:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867551104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380535.504551:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380535.504621:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff88e2180 going to sleep for 11 seconds 00000100:00100000:0.0:1787380535.504675:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867551104 00000100:00100000:0.0:1787380535.504680:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867551104 00000100:00100000:0.0:1787380535.504715:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787380535.504722:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:17196:x1874203867551104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380535.504803:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff639c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:17196:x1874203867551104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380535.504844:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787380535.505047:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867551104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787380535.505782:0:20279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787380535.506081:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787380535.506102:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787380535.506111:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a38c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a393 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380535.506122:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89ca00/0xcf3c46fdcad6a38c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a393 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380535.506131:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787380535.506133:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6fff5a6800 from 13 10000000:01000000:0.0:1787380535.506136:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787380535.506164:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9b800/0xcf3c46fdcad6a39a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380535.506171:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9b800/0xcf3c46fdcad6a39a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380535.506192:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9b800/0xcf3c46fdcad6a39a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380535.506210:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867551232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787380535.506254:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380535.506295:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380535.506397:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867551232 00000100:00100000:3.0:1787380535.506403:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867551232 00000100:00100000:3.0:1787380535.506445:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787380535.506455:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+21:17196:x1874203867551232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380535.506466:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380535.506478:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89cc00/0xcf3c46fdcad6a3a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6a39a expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380535.506499:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89cc00/0xcf3c46fdcad6a3a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a39a expref: 22 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380535.506508:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89cc00/0xcf3c46fdcad6a3a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a39a expref: 22 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380535.506530:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89cc00, rc 0) 00000100:00100000:3.0:1787380535.506568:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff638050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:17196:x1874203867551232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380535.506573:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787380535.506609:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17f9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867551232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380535.506620:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9b800/0xcf3c46fdcad6a39a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a3a1 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380535.506627:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9b800/0xcf3c46fdcad6a39a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad6a3a1 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380535.506669:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867551360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380535.506694:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380535.506706:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff88e2780 going to sleep for 11 seconds 00000100:00100000:3.0:1787380535.506717:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867551360 00000100:00100000:3.0:1787380535.506721:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867551360 00000100:00100000:3.0:1787380535.506736:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787380535.506741:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff63b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:17196:x1874203867551360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380535.506872:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff63b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:17196:x1874203867551360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380535.506878:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787380535.506905:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867551360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380535.506927:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867551488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380535.507046:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380535.507073:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff88e2780 going to sleep for 11 seconds 00000100:00100000:3.0:1787380535.507084:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867551488 00000100:00100000:3.0:1787380535.507090:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867551488 00000100:00100000:3.0:1787380535.507106:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787380535.507111:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:17196:x1874203867551488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380535.507176:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff639450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:17196:x1874203867551488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380535.507254:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787380535.507294:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867551488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787380535.507848:0:20280:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787380535.507891:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787380535.507905:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787380535.507912:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9b800/0xcf3c46fdcad6a39a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a3a1 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380535.508377:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9b800/0xcf3c46fdcad6a39a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a3a1 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787380535.508391:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787380535.508393:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ff3daa800 from 13 10000000:01000000:3.0:1787380535.508396:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787380535.508423:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d800/0xcf3c46fdcad6a3a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380535.508430:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d800/0xcf3c46fdcad6a3a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380535.508439:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d800/0xcf3c46fdcad6a3a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380535.508468:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867551616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787380535.508506:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380535.508572:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff88e2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380535.508681:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867551616 00000100:00100000:0.0:1787380535.508687:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867551616 00000100:00100000:0.0:1787380535.508725:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787380535.508734:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff63a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+22:17196:x1874203867551616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380535.508744:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380535.508761:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9a400/0xcf3c46fdcad6a3af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6a3a8 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380535.508781:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9a400/0xcf3c46fdcad6a3af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a3a8 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380535.508791:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9a400/0xcf3c46fdcad6a3af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a3a8 expref: 23 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380535.508799:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9a400, rc 0) 00000100:00100000:0.0:1787380535.509048:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff63a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:17196:x1874203867551616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 314us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380535.509055:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787380535.509122:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867551616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380535.509135:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d800/0xcf3c46fdcad6a3a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a3af expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380535.509143:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d800/0xcf3c46fdcad6a3a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad6a3af expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380535.509203:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867551744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380535.509228:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380535.509252:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff88e2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380535.509347:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867551744 00000100:00100000:0.0:1787380535.509351:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867551744 00000100:00100000:0.0:1787380535.509382:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787380535.509388:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff63b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:17196:x1874203867551744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380535.509484:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff63b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:17196:x1874203867551744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380535.509490:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787380535.509554:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867551744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380535.509581:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867551872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380535.509614:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380535.509637:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff88e2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380535.509678:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867551872 00000100:00100000:0.0:1787380535.509683:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867551872 00000100:00100000:0.0:1787380535.509711:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787380535.509718:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:17196:x1874203867551872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380535.509789:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:17196:x1874203867551872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380535.509796:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787380535.510054:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c17b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867551872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787380535.511363:0:20281:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787380535.511520:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787380535.511544:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787380535.511553:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d800/0xcf3c46fdcad6a3a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a3af expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380535.511564:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6ffb89d800/0xcf3c46fdcad6a3a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a3af expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787380535.511574:0:17196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787380535.511576:0:17196:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9d6ec3e05800 from 13 10000000:01000000:0.0:1787380535.511579:0:17196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787380535.511607:0:17196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ba00/0xcf3c46fdcad6a3b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380535.511615:0:17196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ba00/0xcf3c46fdcad6a3b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380535.511623:0:17196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ba00/0xcf3c46fdcad6a3b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380535.511641:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867552000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787380535.511688:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380535.511760:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787380535.511792:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867552000 00000100:00100000:3.0:1787380535.511798:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867552000 00000100:00100000:3.0:1787380535.512095:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787380535.512105:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+23:17196:x1874203867552000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787380535.512116:0:17194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380535.512133:0:17194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6ffb89ce00/0xcf3c46fdcad6a3bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf3c46fdcad6a3b6 expref: -99 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380535.512155:0:17194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6ffb89ce00/0xcf3c46fdcad6a3bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a3b6 expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380535.512166:0:17194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6ffb89ce00/0xcf3c46fdcad6a3bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcf3c46fdcad6a3b6 expref: 24 pid: 17194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380535.512174:0:17194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ffb89ce00, rc 0) 00000100:00100000:3.0:1787380535.512234:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:17196:x1874203867552000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380535.512241:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787380535.512305:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867552000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787380535.512319:0:17196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ba00/0xcf3c46fdcad6a3b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a3bd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380535.512327:0:17196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ba00/0xcf3c46fdcad6a3b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcf3c46fdcad6a3bd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380535.512379:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3e9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867552128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380535.512405:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380535.512575:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc39ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787380535.512611:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867552128 00000100:00100000:0.0:1787380535.512615:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867552128 00000100:00100000:0.0:1787380535.512634:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787380535.512640:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:17196:x1874203867552128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380535.512733:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:17196:x1874203867552128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380535.512740:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787380535.512877:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3e9ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867552128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787380535.512911:0:17196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867552256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380535.512959:0:17196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380535.512987:0:17196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6fd041bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787380535.512999:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867552256 00000100:00100000:0.0:1787380535.513002:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867552256 00000100:00100000:0.0:1787380535.513024:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787380535.513030:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:17196:x1874203867552256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787380535.513104:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:17196:x1874203867552256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380535.513110:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787380535.513146:0:17196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7d8d387d-7e15-4118-9d7b-f7697dc8c103:17196:1874203867552256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787380535.513706:0:20282:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787380535.513752:0:17196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787380535.513768:0:17196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.206.130@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787380535.513775:0:17196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ba00/0xcf3c46fdcad6a3b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a3bd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380535.513785:0:17196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.130@tcp lock: ffff9d6fe0a9ba00/0xcf3c46fdcad6a3b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcf3c46fdcad6a3bd expref: -99 pid: 17196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380536.204994:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380536.361640:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380536.361832:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848600192 00000100:00100000:0.0:1787380536.361841:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848600192 00000100:00100000:0.0:1787380536.361888:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 158 00000100:00100000:0.0:1787380536.361897:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+11:14908:x1874203848600192:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380536.361912:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380536.361930:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9a600/0xcf3c46fdcad6a3c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b0f5 expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.361980:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9a600/0xcf3c46fdcad6a3c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0f5 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.361993:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9a600/0xcf3c46fdcad6a3c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0f5 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.362001:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9a600, rc 0) 00000100:00100000:0.0:1787380536.362052:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+12:14908:x1874203848600192:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 Request processed in 156us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380536.362059:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 158 00000100:00100000:3.0:1787380536.368390:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380536.368505:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848600320 00000100:00100000:1.0:1787380536.368514:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848600320 00000100:00100000:1.0:1787380536.368566:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 159 00000100:00100000:1.0:1787380536.368575:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+12:14908:x1874203848600320:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787380536.368701:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+12:14908:x1874203848600320:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 Request processed in 126us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380536.368716:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 159 00000100:00100000:2.0:1787380536.372400:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380536.372472:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848600448 00000100:00100000:3.0:1787380536.372480:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848600448 00000100:00100000:3.0:1787380536.372533:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 160 00000100:00100000:3.0:1787380536.372542:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+12:14908:x1874203848600448:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380536.372677:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+12:14908:x1874203848600448:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 Request processed in 134us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380536.372685:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 160 00000100:00100000:3.0:1787380536.382156:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380536.382600:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848600576 00000100:00100000:0.0:1787380536.382609:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848600576 00000100:00100000:0.0:1787380536.382703:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 161 00000100:00100000:0.0:1787380536.382722:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+12:14908:x1874203848600576:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787380536.382737:0:17193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380536.382764:0:17193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad6a3cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b0fc expref: -99 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.382789:0:17193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad6a3cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0fc expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.382802:0:17193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9d6fe0a9a000/0xcf3c46fdcad6a3cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0fc expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380536.382825:0:17193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe0a9a000, rc 0) 00000100:00100000:0.0:1787380536.382879:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:14908:x1874203848600576:12345-192.168.206.30@tcp:101:ll_cfg_requeue.0 Request processed in 168us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380536.382914:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 161 00000100:00100000:2.0:1787380536.390407:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380536.390476:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848600704 00000100:00100000:3.0:1787380536.390485:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848600704 00000100:00100000:3.0:1787380536.390561:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 162 00000100:00100000:3.0:1787380536.390571:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:14908:x1874203848600704:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787380536.390739:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:14908:x1874203848600704:12345-192.168.206.30@tcp:501:ll_cfg_requeue.0 Request processed in 169us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380536.390756:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 162 00000100:00100000:0.0:1787380536.395330:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380536.395845:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848600832 00000100:00100000:3.0:1787380536.395855:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848600832 00000100:00100000:3.0:1787380536.395907:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 163 00000100:00100000:3.0:1787380536.395916:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:14908:x1874203848600832:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787380536.396067:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:14908:x1874203848600832:12345-192.168.206.30@tcp:503:ll_cfg_requeue.0 Request processed in 151us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380536.396075:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 163 00000040:00080000:0.0:1787380536.588408:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787380537.228087:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787380537.531999:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380537.532173:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848600960 00000100:00100000:2.0:1787380537.532183:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848600960 00000100:00100000:2.0:1787380537.532245:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:2.0:1787380537.532257:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+6:15577:x1874203848600960:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380537.532275:0:19900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380537.532293:0:19900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a3d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b103 expref: -99 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532360:0:19900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532373:0:19900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532383:0:19900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532412:0:19900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532420:0:19900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532427:0:19900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532508:0:19900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47a00/0xcf3c46fdcad6a3e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532516:0:19900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47a00/0xcf3c46fdcad6a3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532524:0:19900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47a00/0xcf3c46fdcad6a3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380537.532551:0:19900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787380537.532555:0:19900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787380537.532586:0:19900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47a00/0xcf3c46fdcad6a3e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532596:0:19900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532602:0:19900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532608:0:19900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532623:0:19900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47c00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380537.532627:0:19900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532634:0:19900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532646:0:19900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25a9f00) 00010000:00010000:2.0:1787380537.532649:0:19900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380537.532653:0:19900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532659:0:19900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532671:0:19900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532676:0:19900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532682:0:19900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532688:0:19900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380537.532691:0:19900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532697:0:19900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532875:0:19900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9d6ec25a9900) 00010000:00010000:2.0:1787380537.532878:0:19900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380537.532881:0:19900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532887:0:19900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532916:0:19900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a3d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b103 expref: 8 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532929:0:19900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47a00/0xcf3c46fdcad6a3e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b103 expref: 7 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.532936:0:19900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d6ec25a9300) 00010000:00010000:2.0:1787380537.532939:0:19900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787380537.532941:0:19900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d47a00, rc 0) 00000100:00100000:2.0:1787380537.533001:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+7:15577:x1874203848600960:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 747us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380537.533008:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00080000:3.0:1787380537.535582:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787380537.538563:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380537.538695:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848601088 00000100:00100000:3.0:1787380537.538705:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848601088 00000100:00100000:3.0:1787380537.538769:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:3.0:1787380537.538779:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:864e2bc1-2781-452d-8411-8f2a646f656c+7:15577:x1874203848601088:12345-192.168.206.30@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787380537.538891:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:864e2bc1-2781-452d-8411-8f2a646f656c+7:15577:x1874203848601088:12345-192.168.206.30@tcp:900:lhsmtool_posix.0 Request processed in 113us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380537.538900:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:0.0:1787380537.547738:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380537.547868:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848601344 00000100:00100000:2.0:1787380537.547877:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848601344 00000100:00100000:2.0:1787380537.547932:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:2.0:1787380537.547942:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+7:15577:x1874203848601344:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380537.547970:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380537.547988:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a3ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b10a expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548084:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3f5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548097:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548108:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548122:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3fc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548128:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548134:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548234:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47800/0xcf3c46fdcad6a403 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548242:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47800/0xcf3c46fdcad6a403 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548249:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47800/0xcf3c46fdcad6a403 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380537.548258:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1787380537.548411:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548428:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3f5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548434:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548440:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380537.548444:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548451:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3f5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548462:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9d6ec25a9300) 00010000:00010000:2.0:1787380537.548465:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380537.548469:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548475:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a3f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548487:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548493:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3fc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548712:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548717:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47c00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380537.548728:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548746:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3fc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548755:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9d6ec25a9900) 00010000:00010000:2.0:1787380537.548757:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380537.548760:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3fc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.548766:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a3fc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.551287:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a3ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b10a expref: 10 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.551312:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47800/0xcf3c46fdcad6a403 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b10a expref: 9 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.551321:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6ec25a9500) 00010000:00010000:2.0:1787380537.551324:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380537.551327:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d47800, rc 0) 00000100:00100000:2.0:1787380537.551442:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+9:15577:x1874203848601344:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 3500us (3711us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787380537.551451:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:0.0:1787380537.559994:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380537.561246:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848601472 00000100:00100000:2.0:1787380537.561403:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848601472 00000100:00100000:2.0:1787380537.561472:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:2.0:1787380537.561482:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+9:15577:x1874203848601472:12345-192.168.206.30@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787380537.562057:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+9:15577:x1874203848601472:12345-192.168.206.30@tcp:59:lhsmtool_posix.0 Request processed in 574us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380537.562066:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:3.0:1787380537.565456:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380537.565565:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848601600 00000100:00100000:0.0:1787380537.565574:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848601600 00000100:00100000:0.0:1787380537.565648:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 26 00000100:00100000:0.0:1787380537.565658:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:864e2bc1-2781-452d-8411-8f2a646f656c+5:15577:x1874203848601600:12345-192.168.206.30@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1787380537.565916:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1787380537.572001:0:17199:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6305us 00000100:00100000:0.0:1787380537.602172:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:864e2bc1-2781-452d-8411-8f2a646f656c+5:15577:x1874203848601600:12345-192.168.206.30@tcp:59:lhsmtool_posix.0 Request processed in 36506us (36716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380537.602185:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 26 00000100:00100000:0.0:1787380537.610589:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380537.610662:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848601728 00000100:00100000:1.0:1787380537.610672:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848601728 00000100:00100000:1.0:1787380537.610738:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 27 00000100:00100000:1.0:1787380537.610748:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+9:15583:x1874203848601728:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1787380537.610766:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380537.610785:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1400/0xcf3c46fdcad6a411 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b111 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.610907:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad6a418 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.610921:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad6a418 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.610932:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad6a418 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.610947:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad6a41f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.610953:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad6a41f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.610970:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad6a41f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.611011:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad6a418 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.611033:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad6a418 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.611039:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad6a418 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.611044:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380537.611048:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad6a418 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.611055:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad6a418 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.611067:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25a9f00) 00010000:00010000:1.0:1787380537.611070:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380537.611074:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad6a418 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.611080:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1200/0xcf3c46fdcad6a418 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.611093:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad6a41f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.611098:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad6a41f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.611103:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad6a41f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.611108:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df0e00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380537.611116:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad6a41f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.611122:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad6a41f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.611129:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d6fc54e7400) 00010000:00010000:1.0:1787380537.611131:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380537.611134:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad6a41f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.611140:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad6a41f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.611170:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1400/0xcf3c46fdcad6a411 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b111 expref: 10 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.611179:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25a9f00) 00010000:00010000:1.0:1787380537.611181:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380537.611184:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1400/0xcf3c46fdcad6a411 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b111 expref: 10 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.611193:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df1400, rc 0) 00000100:00100000:1.0:1787380537.611251:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+9:15583:x1874203848601728:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 505us (671us total) trans 0 rc 301/301 00000100:00100000:1.0:1787380537.611259:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 27 00000040:00080000:0.0:1787380537.612688:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787380537.622030:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380537.622097:0:17208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848601856 00000100:00100000:1.0:1787380537.622106:0:17208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848601856 00000100:00100000:1.0:1787380537.622163:0:17208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:1.0:1787380537.622172:0:17208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:864e2bc1-2781-452d-8411-8f2a646f656c+9:15583:x1874203848601856:12345-192.168.206.30@tcp:700:lfs.0 00000100:00100000:1.0:1787380537.622265:0:17208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:864e2bc1-2781-452d-8411-8f2a646f656c+9:15583:x1874203848601856:12345-192.168.206.30@tcp:700:lfs.0 Request processed in 94us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380537.622283:0:17208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:3.0:1787380537.625110:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380537.625169:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848602112 00000100:00100000:2.0:1787380537.625178:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848602112 00000100:00100000:2.0:1787380537.625239:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 28 00000100:00100000:2.0:1787380537.625248:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+9:15583:x1874203848602112:12345-192.168.206.30@tcp:36:lfs.0 00010000:00010000:2.0:1787380537.625305:0:17201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380537.625329:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a33f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b07e expref: 9 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.625349:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25a9f00) 00010000:00010000:2.0:1787380537.625354:0:17201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380537.625407:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a426 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.625420:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a37e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0ee expref: 5 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.625429:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a426 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.625459:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a37e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0ee expref: 5 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.625473:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a37e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0ee expref: 5 pid: 19900 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380537.625504:0:17201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1874203867552384:192.168.206.30@tcp:104: 00000100:00100000:2.0:1787380537.626628:0:17201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb45c600 going to sleep for 11 seconds 00000100:00100000:2.0:1787380537.631254:0:17201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1874203867552384:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380537.631284:0:17201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a426 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380537.632217:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380537.632312:0:19536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848602240 00000100:00100000:0.0:1787380537.632320:0:19536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848602240 00010000:00010000:0.0:1787380537.632378:0:19536:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a37e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0ee expref: 6 pid: 19900 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380537.632416:0:19536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00100000:0.0:1787380537.632425:0:19536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff518000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:2399:x1874203848602240:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380537.632439:0:19536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380537.632445:0:19536:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a37e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0ee expref: 6 pid: 19900 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.632485:0:19536:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a37e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0ee expref: 6 pid: 19900 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.632617:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0a00/0xcf3c46fdcad6a37e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b0ee expref: 6 pid: 19900 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.632644:0:19536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25a9f00) 00010000:00010000:0.0:1787380537.632649:0:19536:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a426 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.632657:0:19536:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a426 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.632664:0:19536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a426 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.632686:0:19536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380537.632735:0:19536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff518000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+5:2399:x1874203848602240:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 311us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380537.632742:0:19536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 15 00000100:00080000:3.0:1787380537.633615:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787380537.633848:0:17201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a426 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.633859:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a426 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.633886:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a42d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.633896:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a42d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.633916:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a42d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380537.643337:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad6a434 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380537.643423:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad6a434 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380537.643445:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad6a434 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787380537.643613:0:17201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000080582e72 reply state 000000004a3ba2ba transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad6a434 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380537.643692:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad6a434 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380537.643699:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d6ec241a900) 00010000:00010000:3.0:1787380537.643702:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787380537.643705:0:17201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787380537.643768:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787380537.643778:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a426 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380537.643785:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a426 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380537.643790:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a426 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380537.643796:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46e00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380537.643800:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a426 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380537.644036:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a426 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380537.644126:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6ec25a9f00) 00010000:00010000:3.0:1787380537.644129:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380537.644141:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a426 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380537.644146:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a426 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787380537.644164:0:17201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000080582e72 reply state 000000004a3ba2ba transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a42d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380537.644173:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a42d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380537.644179:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d6ec25a9900) 00010000:00010000:3.0:1787380537.644182:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787380537.644184:0:17201:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787380537.644318:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+10:15583:x1874203848602112:12345-192.168.206.30@tcp:36:lfs.0 Request processed in 19066us (19211us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787380537.644328:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 28 00000100:00100000:3.0:1787380537.767969:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380537.768131:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848602368 00000100:00100000:1.0:1787380537.768140:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848602368 00000100:00100000:1.0:1787380537.768243:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 29 00000100:00100000:1.0:1787380537.768254:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+10:15591:x1874203848602368:12345-192.168.206.30@tcp:101:lctl.0 00010000:00010000:1.0:1787380537.768276:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380537.768297:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1400/0xcf3c46fdcad6a43b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b118 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.768353:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad6a442 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.768365:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad6a442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.768377:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad6a442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380537.768416:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787380537.768420:0:17200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787380537.768460:0:17200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad6a442 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.768481:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1400/0xcf3c46fdcad6a43b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b118 expref: 12 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.768510:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0e00/0xcf3c46fdcad6a442 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b118 expref: 11 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.768532:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc54e7400) 00010000:00010000:1.0:1787380537.768534:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787380537.768537:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df0e00, rc 0) 00000100:00100000:1.0:1787380537.768590:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+11:15591:x1874203848602368:12345-192.168.206.30@tcp:101:lctl.0 Request processed in 338us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380537.768596:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 29 00000100:00100000:0.0:1787380537.814408:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380537.817387:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848602496 00000100:00100000:2.0:1787380537.817400:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848602496 00000100:00100000:2.0:1787380537.817480:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 30 00000100:00100000:2.0:1787380537.817490:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+5:15592:x1874203848602496:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1787380537.817508:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380537.817528:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a449 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b11f expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.817609:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a450 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.817623:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.817635:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380537.817674:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787380537.817678:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787380537.817695:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a450 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.817730:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a449 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b11f expref: 7 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.817749:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46a00/0xcf3c46fdcad6a450 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b11f expref: 6 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.817757:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc54e7400) 00010000:00010000:2.0:1787380537.817760:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787380537.817763:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46a00, rc 0) 00000100:00100000:2.0:1787380537.817880:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:15592:x1874203848602496:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 391us (3480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380537.817888:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 30 00000100:00100000:3.0:1787380537.823380:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380537.823763:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848602624 00000100:00100000:2.0:1787380537.823774:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848602624 00000100:00100000:2.0:1787380537.823941:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 31 00000100:00100000:2.0:1787380537.823952:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:15592:x1874203848602624:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1787380537.823984:0:19900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380537.824002:0:19900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a457 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b126 expref: -99 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824180:0:19900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a45e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824195:0:19900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a45e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824206:0:19900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a45e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824217:0:19900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a465 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824224:0:19900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824243:0:19900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824310:0:19900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a46c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824319:0:19900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a46c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824325:0:19900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a46c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380537.824380:0:19900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787380537.824384:0:19900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787380537.824401:0:19900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a46c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824413:0:19900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a45e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824419:0:19900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a45e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824425:0:19900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a45e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824431:0:19900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380537.824434:0:19900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a45e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824442:0:19900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a45e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824454:0:19900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc54e7400) 00010000:00010000:2.0:1787380537.824456:0:19900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380537.824461:0:19900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a45e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824467:0:19900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a45e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824478:0:19900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824495:0:19900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a465 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824502:0:19900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a465 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824507:0:19900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380537.824510:0:19900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a465 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824517:0:19900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a465 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824525:0:19900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d6ec25a9900) 00010000:00010000:2.0:1787380537.824528:0:19900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380537.824531:0:19900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a465 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824537:0:19900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a465 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824575:0:19900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a457 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b126 expref: 8 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824589:0:19900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a46c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b126 expref: 7 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.824596:0:19900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d6ec241a900) 00010000:00010000:2.0:1787380537.824598:0:19900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787380537.824606:0:19900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d47e00, rc 0) 00000100:00100000:2.0:1787380537.824863:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+7:15592:x1874203848602624:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 912us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380537.824871:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 31 00000100:00100000:1.0:1787380537.831077:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380537.831377:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848602752 00000100:00100000:3.0:1787380537.831386:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848602752 00000100:00100000:3.0:1787380537.831460:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:3.0:1787380537.831471:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+5:15592:x1874203848602752:12345-192.168.206.30@tcp:900:lfs.0 00000100:00100000:3.0:1787380537.831551:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+5:15592:x1874203848602752:12345-192.168.206.30@tcp:900:lfs.0 Request processed in 82us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380537.831559:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00080000:0.0:1787380537.831695:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787380537.836677:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380537.836778:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848603008 00000100:00100000:2.0:1787380537.836788:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848603008 00000100:00100000:2.0:1787380537.836870:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 32 00000100:00100000:2.0:1787380537.836880:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+7:15592:x1874203848603008:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1787380537.836898:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380537.836916:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a473 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b12d expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380537.837017:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1787380537.837342:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a473 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b12d expref: 9 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.837357:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc54e7400) 00010000:00010000:2.0:1787380537.837360:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787380537.837365:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a473 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b12d expref: 9 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.837378:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d47200, rc 0) 00000100:00100000:2.0:1787380537.837481:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+8:15592:x1874203848603008:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 602us (811us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787380537.837489:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 32 00000100:00100000:2.0:1787380537.845775:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380537.845935:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848603264 00000100:00100000:1.0:1787380537.845945:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848603264 00000100:00100000:1.0:1787380537.846014:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:1.0:1787380537.846023:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+8:15592:x1874203848603264:12345-192.168.206.30@tcp:36:lfs.0 00010000:00010000:1.0:1787380537.846328:0:17200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380537.846421:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a46c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b126 expref: 8 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.846442:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d6ec241a900) 00010000:00010000:1.0:1787380537.846448:0:17200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380537.846471:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad6a481 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.846483:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad6a481 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.846491:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad6a481 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787380537.846671:0:17200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001ea93ac1 reply state 00000000c63b2760 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad6a481 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.846697:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad6a481 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380537.846703:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d6ec241a900) 00010000:00010000:1.0:1787380537.846706:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1787380537.846942:0:17200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787380537.846950:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787380537.847043:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+9:15592:x1874203848603264:12345-192.168.206.30@tcp:36:lfs.0 Request processed in 1019us (1333us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787380537.847053:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 33 00000100:00100000:1.0:1787380537.850856:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380537.851223:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848603520 00000100:00100000:2.0:1787380537.851246:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848603520 00000100:00100000:2.0:1787380537.851310:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:2.0:1787380537.851319:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+9:15592:x1874203848603520:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1787380537.851895:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+10:15592:x1874203848603520:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 575us (1082us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787380537.851905:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:3.0:1787380537.857928:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380537.858269:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848603776 00000100:00100000:0.0:1787380537.858278:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848603776 00000100:00100000:0.0:1787380537.858333:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00100000:0.0:1787380537.858343:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+10:15592:x1874203848603776:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1787380537.858378:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380537.858397:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a488 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b134 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858466:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a48f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858480:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a48f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858491:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a48f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858504:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a496 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858512:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a496 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858518:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a496 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380537.858613:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787380537.858679:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a48f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858686:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a48f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858692:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a48f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858707:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866c00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380537.858711:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a48f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858718:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a48f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858730:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc54e7400) 00010000:00010000:0.0:1787380537.858732:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380537.858736:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a48f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858741:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a48f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858752:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a496 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858758:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a496 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858763:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a496 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858768:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380537.858770:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a496 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858775:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a496 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858792:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d6ec25a9900) 00010000:00010000:0.0:1787380537.858795:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380537.858797:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a496 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858803:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a496 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858875:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a488 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b134 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858885:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc54e7400) 00010000:00010000:0.0:1787380537.858887:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787380537.858891:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a488 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b134 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.858900:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866e00, rc 0) 00000100:00100000:0.0:1787380537.858970:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+11:15592:x1874203848603776:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 627us (1050us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787380537.858978:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 34 00000100:00100000:3.0:1787380537.866762:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380537.866860:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848603904 00000100:00100000:0.0:1787380537.866870:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848603904 00000100:00100000:0.0:1787380537.866920:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 35 00000100:00100000:0.0:1787380537.866930:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+11:15592:x1874203848603904:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:0.0:1787380537.866953:0:19900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380537.866983:0:19900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a4a4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b13b expref: -99 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.867108:0:19900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6a4ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.867131:0:19900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6a4ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.867141:0:19900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6a4ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380537.867165:0:19900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787380537.867169:0:19900:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787380537.867185:0:19900:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6a4ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.867209:0:19900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a4a4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b13b expref: 13 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.867661:0:19900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6a4ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b13b expref: 12 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.867672:0:19900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d6ec241a900) 00010000:00010000:0.0:1787380537.867674:0:19900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787380537.867678:0:19900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7867a00, rc 0) 00000100:00100000:0.0:1787380537.867742:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+12:15592:x1874203848603904:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 813us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380537.867750:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 35 00000100:00100000:3.0:1787380537.874580:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380537.874686:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848604032 00000100:00100000:0.0:1787380537.874696:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848604032 00000100:00100000:0.0:1787380537.874761:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:0.0:1787380537.874770:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+12:15592:x1874203848604032:12345-192.168.206.30@tcp:37:lfs.0 00000100:00100000:0.0:1787380537.878281:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+12:15592:x1874203848604032:12345-192.168.206.30@tcp:37:lfs.0 Request processed in 3502us (3699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380537.878296:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 3 00000100:00100000:3.0:1787380537.884051:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380537.884304:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848604288 00000100:00100000:2.0:1787380537.884313:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848604288 00000100:00100000:2.0:1787380537.884366:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 4 00000100:00100000:2.0:1787380537.884374:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffc948050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+12:15592:x1874203848604288:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1787380537.884549:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffc948050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+13:15592:x1874203848604288:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 175us (505us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787380537.884556:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 4 00000040:00080000:0.0:1787380537.932443:0:17958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787380537.935584:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380537.937417:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848604416 00000100:00100000:0.0:1787380537.937430:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848604416 00000100:00100000:0.0:1787380537.937501:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 36 00000100:00100000:0.0:1787380537.937512:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+11:15598:x1874203848604416:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1787380537.937542:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380537.937561:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a4b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b142 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.937626:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a4b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.937641:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a4b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.937651:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a4b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.937661:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.937667:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.937673:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.937757:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6a4c7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.937767:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6a4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.937775:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6a4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380537.937850:0:17201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787380537.937855:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787380537.937904:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6a4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.937917:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a4b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.937923:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a4b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.937930:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a4b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.937936:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866e00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380537.937940:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a4b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.937947:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a4b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.937967:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc54e7400) 00010000:00010000:0.0:1787380537.937978:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380537.937983:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a4b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.937989:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a4b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.938003:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.938008:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.938014:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.938018:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:0.0:1787380537.938021:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.938026:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.938033:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d6ec25a9900) 00010000:00010000:0.0:1787380537.938036:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787380537.938038:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.938043:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.938626:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a4b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b142 expref: 13 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.938662:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866600/0xcf3c46fdcad6a4c7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b142 expref: 12 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.938670:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d6ec241a900) 00010000:00010000:0.0:1787380537.938673:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787380537.938675:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866600, rc 0) 00000100:00100000:0.0:1787380537.938792:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+12:15598:x1874203848604416:12345-192.168.206.30@tcp:101:bash.0 Request processed in 1280us (3213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380537.938800:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 36 00000100:00100000:3.0:1787380537.949560:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380537.949883:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848604544 00000100:00100000:2.0:1787380537.949904:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848604544 00000100:00100000:2.0:1787380537.949976:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:2.0:1787380537.949985:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:864e2bc1-2781-452d-8411-8f2a646f656c+5:15598:x1874203848604544:12345-192.168.206.30@tcp:900:bash.0 00000100:00100000:2.0:1787380537.950084:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:864e2bc1-2781-452d-8411-8f2a646f656c+5:15598:x1874203848604544:12345-192.168.206.30@tcp:900:bash.0 Request processed in 98us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380537.950095:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:3.0:1787380537.953196:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380537.953466:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848604800 00000100:00100000:0.0:1787380537.953480:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848604800 00000100:00100000:0.0:1787380537.953543:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 37 00000100:00100000:0.0:1787380537.953555:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+12:15598:x1874203848604800:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:0.0:1787380537.953577:0:19900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380537.953599:0:19900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a4ce lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b149 expref: -99 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.953696:0:19900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4d5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.953710:0:19900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6a4ab lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b13b expref: 12 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.953719:0:19900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4d5 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.953750:0:19900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6a4ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b13b expref: 12 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.953777:0:19900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6a4ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b13b expref: 12 pid: 19900 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380537.953789:0:19900:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19900:1874203867552512:192.168.206.30@tcp:104: 00000100:00100000:0.0:1787380537.954180:0:19900:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff4c99e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787380537.956905:0:19900:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19900:1874203867552512:192.168.206.30@tcp:104: 00010000:00010000:0.0:1787380537.956933:0:19900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4d5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380537.957848:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380537.957930:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848604928 00000100:00100000:0.0:1787380537.957937:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848604928 00010000:00010000:0.0:1787380537.957984:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6a4ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b13b expref: 13 pid: 19900 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380537.958024:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 16 00000100:00100000:0.0:1787380537.958033:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff519f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+13:2400:x1874203848604928:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380537.958048:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380537.958238:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6a4ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b13b expref: 13 pid: 19900 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.958254:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6a4ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b13b expref: 13 pid: 19900 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.958283:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7867a00/0xcf3c46fdcad6a4ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b13b expref: 13 pid: 19900 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.958316:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d6ec241a900) 00010000:00010000:0.0:1787380537.958320:0:17184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4d5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.958330:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.958338:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4d5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380537.958370:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380537.958490:0:19900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.958499:0:19900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.958522:0:19900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a4dc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.958543:0:19900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a4dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.958551:0:19900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a4dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.959014:0:19900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a4e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.959023:0:19900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.959030:0:19900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380537.959039:0:19900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00100000:0.0:1787380537.960343:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff519f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+12:2400:x1874203848604928:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 2303us (2492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380537.960356:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 16 00010000:00010000:2.0:1787380537.960503:0:19900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4d5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.960513:0:19900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4d5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.960519:0:19900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4d5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.960525:0:19900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866a00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380537.960528:0:19900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4d5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.960535:0:19900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4d5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.960567:0:19900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d6ec241a900) 00010000:00010000:2.0:1787380537.960581:0:19900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380537.960587:0:19900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4d5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.960593:0:19900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a4d5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380537.960608:0:19900:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000475a92e1 reply state 0000000035072c27 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a4dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.960619:0:19900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a4dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.960625:0:19900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9d6ec25a9a00) 00010000:00010000:2.0:1787380537.960628:0:19900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787380537.960631:0:19900:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787380537.960670:0:19900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a4ce lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b149 expref: 15 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.960684:0:19900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b149 expref: 14 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.960691:0:19900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:2.0:1787380537.960694:0:19900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787380537.960696:0:19900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46000, rc 0) 00000100:00100000:2.0:1787380537.960749:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+15:15598:x1874203848604800:12345-192.168.206.30@tcp:101:bash.0 Request processed in 7196us (7562us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787380537.960756:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 37 00000100:00100000:3.0:1787380537.973904:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380537.974845:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848605056 00000100:00100000:2.0:1787380537.974857:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848605056 00000100:00100000:2.0:1787380537.974928:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 38 00000100:00100000:2.0:1787380537.974937:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:864e2bc1-2781-452d-8411-8f2a646f656c+15:15598:x1874203848605056:12345-192.168.206.30@tcp:101:bash.0 00010000:00010000:2.0:1787380537.974970:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380537.974990:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a4f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b150 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.975068:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a4f8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.975082:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.975094:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380537.975137:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787380537.975140:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787380537.975158:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.975168:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a4f8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.975191:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a4f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b150 expref: 17 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.975207:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a4f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b150 expref: 16 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380537.975234:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:2.0:1787380537.975236:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380537.975240:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d47000, rc 0) 00000100:00100000:2.0:1787380537.975303:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:864e2bc1-2781-452d-8411-8f2a646f656c+16:15598:x1874203848605056:12345-192.168.206.30@tcp:101:bash.0 Request processed in 366us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380537.975310:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 38 00000100:00100000:3.0:1787380537.977896:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380537.984027:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848605312 00000100:00100000:2.0:1787380537.984041:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848605312 00000100:00100000:2.0:1787380537.984103:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:2.0:1787380537.984112:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:864e2bc1-2781-452d-8411-8f2a646f656c+16:15598:x1874203848605312:12345-192.168.206.30@tcp:35:bash.0 00000100:00100000:2.0:1787380537.984373:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:864e2bc1-2781-452d-8411-8f2a646f656c+17:15598:x1874203848605312:12345-192.168.206.30@tcp:35:bash.0 Request processed in 261us (6486us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787380537.984381:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 5 00000100:00100000:3.0:1787380538.102205:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380538.102330:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848605568 00000100:00100000:1.0:1787380538.102339:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848605568 00000100:00100000:1.0:1787380538.102517:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 39 00000100:00100000:1.0:1787380538.102528:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+17:15608:x1874203848605568:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:1.0:1787380538.102551:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380538.102572:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0000/0xcf3c46fdcad6a4ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b157 expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787380538.102662:0:17200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787380538.102758:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0000/0xcf3c46fdcad6a4ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b157 expref: 19 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.102772:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9d6fc54e7400) 00010000:00010000:1.0:1787380538.102775:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787380538.102781:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0000/0xcf3c46fdcad6a4ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b157 expref: 19 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.102856:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df0000, rc 0) 00000100:00100000:1.0:1787380538.103060:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+18:15608:x1874203848605568:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 533us (862us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1787380538.103068:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 39 00000100:00100000:3.0:1787380538.106968:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.107121:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848605824 00000100:00100000:2.0:1787380538.107131:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848605824 00000100:00100000:2.0:1787380538.107232:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:2.0:1787380538.107243:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:864e2bc1-2781-452d-8411-8f2a646f656c+18:15608:x1874203848605824:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:2.0:1787380538.107787:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:864e2bc1-2781-452d-8411-8f2a646f656c+19:15608:x1874203848605824:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 543us (835us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787380538.107796:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 6 00000100:00100000:3.0:1787380538.144235:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.144328:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848606080 00000100:00100000:2.0:1787380538.144339:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848606080 00000100:00100000:2.0:1787380538.144405:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 40 00000100:00100000:2.0:1787380538.144415:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:864e2bc1-2781-452d-8411-8f2a646f656c+19:15611:x1874203848606080:12345-192.168.206.30@tcp:101:lfs.0 00010000:00010000:2.0:1787380538.144452:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380538.144471:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a50d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b15e expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.144582:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a514 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.144609:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a514 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.144619:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a514 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380538.144632:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787380538.144731:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a50d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b15e expref: 22 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.144749:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a514 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b15e expref: 21 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.144758:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:2.0:1787380538.144761:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380538.144764:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46200, rc 0) 00000100:00100000:2.0:1787380538.144864:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:864e2bc1-2781-452d-8411-8f2a646f656c+21:15611:x1874203848606080:12345-192.168.206.30@tcp:101:lfs.0 Request processed in 450us (638us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787380538.144872:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 40 00000100:00100000:3.0:1787380538.148233:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380538.148321:0:19536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848606208 00000100:00100000:0.0:1787380538.148330:0:19536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848606208 00000100:00100000:0.0:1787380538.148407:0:19536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:0.0:1787380538.148418:0:19536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff519c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:864e2bc1-2781-452d-8411-8f2a646f656c+21:2398:x1874203848606208:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380538.148453:0:19536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380538.148477:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a514 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b15e expref: 21 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.148497:0:19536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:0.0:1787380538.148501:0:19536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380538.148559:0:19536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff519c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:864e2bc1-2781-452d-8411-8f2a646f656c+20:2398:x1874203848606208:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 144us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380538.148567:0:19536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:3.0:1787380538.152088:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.152181:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848606336 00000100:00100000:2.0:1787380538.152191:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848606336 00000100:00100000:2.0:1787380538.152246:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 41 00000100:00100000:2.0:1787380538.152270:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+20:15611:x1874203848606336:12345-192.168.206.30@tcp:54:lfs.0 00010000:00010000:2.0:1787380538.152336:0:19900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a522 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.152351:0:19900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a522 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.152376:0:19900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a522 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.152410:0:19900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a522 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.152418:0:19900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a522 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.152425:0:19900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a522 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.152431:0:19900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380538.152435:0:19900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a522 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.152442:0:19900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a522 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.152461:0:19900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:2.0:1787380538.152464:0:19900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787380538.152469:0:19900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a522 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.152476:0:19900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a522 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380538.152553:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+20:15611:x1874203848606336:12345-192.168.206.30@tcp:54:lfs.0 Request processed in 285us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380538.152561:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 41 00000100:00100000:3.0:1787380538.155851:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380538.156136:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848606592 00000100:00100000:0.0:1787380538.156146:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848606592 00000100:00100000:0.0:1787380538.156200:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 7 00000100:00100000:0.0:1787380538.156211:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fff51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:864e2bc1-2781-452d-8411-8f2a646f656c+20:15611:x1874203848606592:12345-192.168.206.30@tcp:35:lfs.0 00000100:00100000:0.0:1787380538.156417:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fff51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:864e2bc1-2781-452d-8411-8f2a646f656c+21:15611:x1874203848606592:12345-192.168.206.30@tcp:35:lfs.0 Request processed in 208us (573us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787380538.156425:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 7 00010000:00010000:3.0:1787380538.252035:0:20229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380538.393199:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.393296:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848606848 00000100:00100000:2.0:1787380538.393305:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848606848 00000100:00100000:2.0:1787380538.393361:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00100000:2.0:1787380538.393371:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:864e2bc1-2781-452d-8411-8f2a646f656c+21:15642:x1874203848606848:12345-192.168.206.30@tcp:101:cat.0 00010000:00010000:2.0:1787380538.393392:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380538.393410:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a529 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b165 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.393518:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6a530 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.393531:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6a530 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.393541:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6a530 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380538.393551:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787380538.393676:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a529 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b165 expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.393694:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6a530 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b165 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.393704:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:2.0:1787380538.393724:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787380538.393727:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46c00, rc 0) 00000100:00100000:2.0:1787380538.393782:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:864e2bc1-2781-452d-8411-8f2a646f656c+23:15642:x1874203848606848:12345-192.168.206.30@tcp:101:cat.0 Request processed in 412us (591us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787380538.393789:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 42 00000100:00100000:3.0:1787380538.398589:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380538.398663:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848606976 00000100:00100000:1.0:1787380538.398671:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848606976 00000100:00100000:1.0:1787380538.398735:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00100000:1.0:1787380538.398743:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:864e2bc1-2781-452d-8411-8f2a646f656c+23:2399:x1874203848606976:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380538.398757:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380538.398779:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6a530 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b165 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.398795:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:1.0:1787380538.398800:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380538.398890:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:864e2bc1-2781-452d-8411-8f2a646f656c+22:2399:x1874203848606976:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 147us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380538.398899:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00100000:3.0:1787380538.401703:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380538.401964:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848607232 00000100:00100000:0.0:1787380538.401973:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848607232 00000100:00100000:2.0:1787380538.402141:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:2.0:1787380538.402153:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:864e2bc1-2781-452d-8411-8f2a646f656c+22:15642:x1874203848607232:12345-192.168.206.30@tcp:35:cat.0 00000100:00100000:2.0:1787380538.402629:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:864e2bc1-2781-452d-8411-8f2a646f656c+23:15642:x1874203848607232:12345-192.168.206.30@tcp:35:cat.0 Request processed in 477us (931us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787380538.402637:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:3.0:1787380538.468061:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.468315:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848607488 00000100:00100000:2.0:1787380538.468324:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848607488 00000100:00100000:2.0:1787380538.468542:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 43 00000100:00100000:2.0:1787380538.468554:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+23:15648:x1874203848607488:12345-192.168.206.30@tcp:101:dd.0 00010000:00010000:2.0:1787380538.468574:0:19900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380538.468603:0:19900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a53e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b16c expref: -99 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.468714:0:19900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6a545 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.468728:0:19900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a4e3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b149 expref: 24 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.468735:0:19900:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a4f8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b150 expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.468977:0:19900:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6a545 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.469010:0:19900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a4f8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b150 expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.469024:0:19900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a4f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b150 expref: 24 pid: 17199 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380538.469037:0:19900:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19900:1874203867552640:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380538.469243:0:19900:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b149 expref: 24 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.469252:0:19900:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a4e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b149 expref: 24 pid: 19900 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380538.469261:0:19900:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19900:1874203867552768:192.168.206.30@tcp:104: 00000100:00100000:2.0:1787380538.469285:0:19900:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb6bc9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787380538.472485:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380538.472523:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380538.472618:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848607616 00000100:00100000:1.0:1787380538.472627:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848607616 00010000:00010000:1.0:1787380538.472663:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a4f8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b150 expref: 25 pid: 17199 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380538.472702:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848607744 00000100:00100000:1.0:1787380538.472706:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848607744 00010000:00010000:1.0:1787380538.472718:0:17186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a4e3 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b149 expref: 26 pid: 19900 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380538.472770:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:1.0:1787380538.472780:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:864e2bc1-2781-452d-8411-8f2a646f656c+26:2399:x1874203848607616:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787380538.472795:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380538.472802:0:17186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a4f8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b150 expref: 26 pid: 17199 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.472831:0:17186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a4f8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b150 expref: 26 pid: 17199 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.472852:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:1.0:1787380538.472857:0:17186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6a545 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.472865:0:17186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6a545 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.472871:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380538.473535:0:19900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a4f8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b150 expref: 26 pid: 17199 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380538.473555:0:19900:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c9aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19900:1874203867552640:192.168.206.30@tcp:104: 00000100:00100000:2.0:1787380538.473566:0:19900:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19900:1874203867552768:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380538.473601:0:19900:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6a545 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380538.473660:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 18 00000100:00100000:2.0:1787380538.473669:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fef75d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:864e2bc1-2781-452d-8411-8f2a646f656c+25:2399:x1874203848607744:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380538.473680:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380538.473686:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a4e3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b149 expref: 25 pid: 19900 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.473709:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b149 expref: 25 pid: 19900 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.473723:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a4e3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b149 expref: 25 pid: 19900 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.473734:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:2.0:1787380538.473737:0:17184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6a545 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.473754:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6a545 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.473762:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6a545 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.473781:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787380538.474975:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:864e2bc1-2781-452d-8411-8f2a646f656c+24:2399:x1874203848607616:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 2189us (2492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380538.474987:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 17 00000100:00100000:2.0:1787380538.475257:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fef75d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:864e2bc1-2781-452d-8411-8f2a646f656c+23:2399:x1874203848607744:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 1588us (2731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380538.475266:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 18 00010000:00010000:2.0:1787380538.475325:0:19900:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6a545 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.475345:0:19900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6a545 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380538.475377:0:19900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787380538.475533:0:19900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a53e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b16c expref: 24 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.475551:0:19900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46800/0xcf3c46fdcad6a545 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b16c expref: 23 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.475560:0:19900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:2.0:1787380538.475563:0:19900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787380538.475566:0:19900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46800, rc 0) 00000100:00100000:2.0:1787380538.478982:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+23:15648:x1874203848607488:12345-192.168.206.30@tcp:101:dd.0 Request processed in 10421us (10919us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787380538.478996:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 43 00000100:00100000:1.0:1787380538.489480:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.494658:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848607872 00000100:00100000:2.0:1787380538.494672:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848607872 00000100:00100000:2.0:1787380538.494927:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 44 00000100:00100000:2.0:1787380538.494938:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:864e2bc1-2781-452d-8411-8f2a646f656c+23:15648:x1874203848607872:12345-192.168.206.30@tcp:101:dd.0 00010000:00010000:2.0:1787380538.494972:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380538.494995:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a553 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b173 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.495026:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a55a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.495066:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a55a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.495077:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a55a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.496411:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a553 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b173 expref: 25 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.496439:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a55a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b173 expref: 24 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.496447:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:2.0:1787380538.496450:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787380538.496453:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46000, rc 0) 00000100:00100000:2.0:1787380538.496793:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:864e2bc1-2781-452d-8411-8f2a646f656c+24:15648:x1874203848607872:12345-192.168.206.30@tcp:101:dd.0 Request processed in 1855us (7319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380538.496802:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 44 00000100:00100000:3.0:1787380538.503525:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380538.504415:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848608128 00000100:00100000:0.0:1787380538.504425:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848608128 00000100:00100000:0.0:1787380538.504536:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 45 00000100:00100000:0.0:1787380538.504546:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+24:15648:x1874203848608128:12345-192.168.206.30@tcp:36:dd.0 00010000:00010000:0.0:1787380538.504746:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a561 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.504764:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a561 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.504775:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a561 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787380538.504831:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1787380538.504856:0:17201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000010e100cb reply state 00000000748989dd transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a561 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.504875:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a561 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.504882:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:0.0:1787380538.504899:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787380538.504903:0:17201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787380538.505009:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+27:15648:x1874203848608128:12345-192.168.206.30@tcp:36:dd.0 Request processed in 464us (1492us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1787380538.505017:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 45 00000020:00080000:0.0:1787380538.505021:0:17201:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787380538.507688:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380538.507778:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848608256 00000100:00100000:1.0:1787380538.507787:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848608256 00000100:00100000:1.0:1787380538.507978:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 46 00000100:00100000:1.0:1787380538.507989:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+27:15648:x1874203848608256:12345-192.168.206.30@tcp:101:dd.0 00010000:00010000:1.0:1787380538.508012:0:17200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787380538.508296:0:17200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0800/0xcf3c46fdcad6a568 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b17a expref: -99 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.508346:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0800/0xcf3c46fdcad6a568 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b17a expref: 28 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.508415:0:17200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0800/0xcf3c46fdcad6a568 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b17a expref: 28 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.508432:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:1.0:1787380538.508435:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787380538.508438:0:17200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ec3df0800, rc 0) 00000100:00100000:1.0:1787380538.508488:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+28:15648:x1874203848608256:12345-192.168.206.30@tcp:101:dd.0 Request processed in 502us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380538.508681:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 46 00000100:00100000:1.0:1787380538.522913:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.523234:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848608512 00000100:00100000:2.0:1787380538.523244:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848608512 00000100:00100000:2.0:1787380538.523339:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:2.0:1787380538.523350:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:864e2bc1-2781-452d-8411-8f2a646f656c+28:15648:x1874203848608512:12345-192.168.206.30@tcp:103:dd.0 00010000:00010000:2.0:1787380538.523364:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380538.523388:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0800/0xcf3c46fdcad6a568 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b17a expref: 28 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.523407:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:2.0:1787380538.523425:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380538.523488:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:864e2bc1-2781-452d-8411-8f2a646f656c+27:15648:x1874203848608512:12345-192.168.206.30@tcp:103:dd.0 Request processed in 140us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380538.523496:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 2 00000100:00100000:3.0:1787380538.525536:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380538.526674:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848608640 00000100:00100000:0.0:1787380538.526686:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848608640 00000100:00100000:0.0:1787380538.526938:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 47 00000100:00100000:0.0:1787380538.526950:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+27:15648:x1874203848608640:12345-192.168.206.30@tcp:58:dd.0 00010000:00010000:0.0:1787380538.527078:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6a56f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.527176:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6a56f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.527190:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6a56f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787380538.530190:0:17201:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787380538.530602:0:17201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787380538.530799:0:17201:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787380538.531272:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+27:15648:x1874203848608640:12345-192.168.206.30@tcp:58:dd.0 Request processed in 4320us (5736us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380538.531283:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 47 00000100:00100000:3.0:1787380538.537982:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.541987:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848608768 00000100:00100000:2.0:1787380538.542001:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848608768 00000100:00100000:2.0:1787380538.542077:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 48 00000100:00100000:2.0:1787380538.542088:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:864e2bc1-2781-452d-8411-8f2a646f656c+27:15648:x1874203848608768:12345-192.168.206.30@tcp:101:dd.0 00010000:00010000:2.0:1787380538.542110:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380538.542130:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a576 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b181 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.542181:0:17199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6a56f lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.542192:0:17199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a576 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b181 expref: 28 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.542211:0:17199:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6a56f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.542223:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a576 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b181 expref: 28 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.542236:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:2.0:1787380538.542239:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787380538.542243:0:17199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a576 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b181 expref: 28 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.542338:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d47600, rc 0) 00000100:00100000:2.0:1787380538.542595:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:864e2bc1-2781-452d-8411-8f2a646f656c+28:15648:x1874203848608768:12345-192.168.206.30@tcp:101:dd.0 Request processed in 508us (4621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380538.542604:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 48 00000040:00080000:0.0:1787380538.636010:0:17233:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787380538.636019:0:17233:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787380538.636042:0:17233:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787380538.636049:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787380538.636175:0:17233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fd17f8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17233:1874203867552896:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787380538.636263:0:17233:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc956a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787380538.648701:0:17233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fd17f8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17233:1874203867552896:192.168.206.30@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787380538.651115:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.651767:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848608896 00000100:00100000:2.0:1787380538.651777:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848608896 00000100:00100000:2.0:1787380538.651994:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 49 00000100:00100000:2.0:1787380538.652004:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+28:15649:x1874203848608896:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787380538.652034:0:19900:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787380538.652224:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+28:15649:x1874203848608896:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 221us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380538.652233:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 49 00000100:00100000:3.0:1787380538.672919:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.673362:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848609024 00000100:00100000:2.0:1787380538.673372:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848609024 00000100:00100000:2.0:1787380538.673431:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 50 00000100:00100000:2.0:1787380538.673441:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:864e2bc1-2781-452d-8411-8f2a646f656c+28:15649:x1874203848609024:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787380538.673516:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a57d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.673533:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a57d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.673555:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a57d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.673608:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6a584 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.673628:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6a584 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.673635:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6a584 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.673658:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a58b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.673666:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a58b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.673673:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a58b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380538.674015:0:17199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787380538.674020:0:17199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787380538.674032:0:17199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a58b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674042:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a57d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674048:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a57d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674054:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a57d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674060:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47000 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380538.674064:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a57d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674078:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a57d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674102:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6ec25a9500) 00010000:00010000:2.0:1787380538.674106:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380538.674111:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a57d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674118:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a57d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674294:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6a584 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674300:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6a584 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674306:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6a584 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674310:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46c00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380538.674313:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6a584 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674319:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6a584 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674327:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9d6ec25a9d00) 00010000:00010000:2.0:1787380538.674329:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380538.674332:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6a584 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674362:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46c00/0xcf3c46fdcad6a584 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674377:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a58b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674383:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a58b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674389:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a58b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674393:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380538.674395:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a58b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674401:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a58b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674409:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:2.0:1787380538.674411:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787380538.674414:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a58b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.674420:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a58b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380538.674660:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:864e2bc1-2781-452d-8411-8f2a646f656c+28:15649:x1874203848609024:12345-192.168.206.30@tcp:34:lhsmtool_posix.0 Request processed in 1217us (1747us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380538.674670:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 50 00000100:00100000:3.0:1787380538.680985:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.681262:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848609280 00000100:00100000:2.0:1787380538.681272:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848609280 00000100:00100000:2.0:1787380538.681332:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 51 00000100:00100000:2.0:1787380538.681344:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+28:15649:x1874203848609280:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380538.681375:0:19900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380538.681395:0:19900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a592 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b188 expref: -99 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.681495:0:19900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a599 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.681510:0:19900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a599 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.681523:0:19900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a599 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787380538.681534:0:19900:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787380538.681620:0:19900:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a599 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.681627:0:19900:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a599 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.681633:0:19900:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a599 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.681638:0:19900:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:2.0:1787380538.681642:0:19900:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a599 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.681649:0:19900:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a599 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.681674:0:19900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:2.0:1787380538.681677:0:19900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787380538.681681:0:19900:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a599 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.681687:0:19900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a599 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.681725:0:19900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a592 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b188 expref: 30 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.681735:0:19900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9d6ec25a9500) 00010000:00010000:2.0:1787380538.681737:0:19900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787380538.681741:0:19900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a592 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b188 expref: 30 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.681760:0:19900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d47e00, rc 0) 00000100:00100000:2.0:1787380538.681847:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+29:15649:x1874203848609280:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 505us (870us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787380538.681855:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 51 00000100:00100000:3.0:1787380538.685345:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380538.685571:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848609408 00000100:00100000:1.0:1787380538.685581:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848609408 00000100:00100000:1.0:1787380538.685673:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 52 00000100:00100000:1.0:1787380538.685683:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+29:15649:x1874203848609408:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787380538.685727:0:17200:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787380538.685882:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+29:15649:x1874203848609408:12345-192.168.206.30@tcp:53:lhsmtool_posix.0 Request processed in 200us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380538.685890:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 52 00000100:00100000:0.0:1787380538.690733:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380538.691020:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848609664 00000100:00100000:3.0:1787380538.691029:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848609664 00000100:00100000:3.0:1787380538.691144:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 53 00000100:00100000:3.0:1787380538.691154:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fd17f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+29:15649:x1874203848609664:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380538.691173:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380538.691192:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad6a5a7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b18f expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787380538.691901:0:17201:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:3.0:1787380538.691909:0:17201:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:3.0:1787380538.691930:0:17201:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:3.0:1787380538.692243:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb400/0xcf3c46fdcad6a5ae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.692258:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb400/0xcf3c46fdcad6a5ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.692269:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb400/0xcf3c46fdcad6a5ae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.692324:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c200/0xcf3c46fdcad6a5a7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b18f expref: 32 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.692339:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb400/0xcf3c46fdcad6a5ae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b18f expref: 31 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.692347:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6ec241a100) 00010000:00010000:3.0:1787380538.692349:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787380538.692351:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fdb400, rc 0) 00000100:00100000:3.0:1787380538.692455:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fd17f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+31:15649:x1874203848609664:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 1303us (1729us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1787380538.692462:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 53 00000100:00100000:3.0:1787380538.706540:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.709017:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848609920 00000100:00100000:2.0:1787380538.709031:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848609920 00000100:00100000:1.0:1787380538.709227:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 54 00000100:00100000:1.0:1787380538.709241:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+31:15649:x1874203848609920:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787380538.709301:0:17200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787380538.709338:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdb400/0xcf3c46fdcad6a5ae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b18f expref: 31 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709357:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6ec241a100) 00010000:00010000:1.0:1787380538.709368:0:17200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787380538.709392:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad6a5bc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709405:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad6a5bc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709414:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad6a5bc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709427:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5c3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc0f9a806 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709434:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc0f9a806 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709440:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc0f9a806 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709501:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad6a5bc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709509:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad6a5bc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709515:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad6a5bc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709520:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df0200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380538.709530:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad6a5bc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709538:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad6a5bc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709547:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d6ec241a900) 00010000:00010000:1.0:1787380538.709551:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380538.709554:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad6a5bc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709561:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df0200/0xcf3c46fdcad6a5bc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709571:0:17200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc0f9a806 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709577:0:17200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5c3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc0f9a806 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709582:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc0f9a806 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709587:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1e00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380538.709589:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc0f9a806 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709594:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5c3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc0f9a806 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709601:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xc0f9a806 (ffff9d6fc54e7600) 00010000:00010000:1.0:1787380538.709603:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787380538.709614:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5c3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc0f9a806 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.709620:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5c3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc0f9a806 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380538.709708:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+30:15649:x1874203848609920:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 471us (3177us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787380538.709716:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 54 00000100:00100000:0.0:1787380538.717893:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.718289:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848610048 00000100:00100000:2.0:1787380538.718300:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848610048 00000100:00100000:2.0:1787380538.718358:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 55 00000100:00100000:2.0:1787380538.718367:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+30:15649:x1874203848610048:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380538.718385:0:19900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380538.718417:0:19900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a5ca lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b196 expref: -99 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.718450:0:19900:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a5d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.718461:0:19900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.718472:0:19900:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.718571:0:19900:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a5ca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b196 expref: 32 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.718589:0:19900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47400/0xcf3c46fdcad6a5d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b196 expref: 31 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.718597:0:19900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6ec25a9d00) 00010000:00010000:2.0:1787380538.718600:0:19900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787380538.718603:0:19900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d47400, rc 0) 00000100:00100000:2.0:1787380538.718670:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+31:15649:x1874203848610048:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 304us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380538.718677:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 55 00000100:00100000:0.0:1787380538.722630:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380538.722735:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848610304 00000100:00100000:1.0:1787380538.722745:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848610304 00000100:00100000:1.0:1787380538.722836:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 56 00000100:00100000:1.0:1787380538.722845:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+31:15649:x1874203848610304:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787380538.723307:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5d8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.723322:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.723332:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787380538.723482:0:17200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1787380538.723490:0:17200:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 549047679930ns, next at 550047678245ns, rc = 0 00000004:00010000:1.0:1787380538.723529:0:17200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a11c150c reply state 0000000088deb9d6 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5d8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.723540:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.723547:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6ec25a9d00) 00010000:00010000:1.0:1787380538.723560:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787380538.723563:0:17200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787380538.723693:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+33:15649:x1874203848610304:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 847us (1069us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1787380538.723709:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 56 00000100:00100000:0.0:1787380538.727309:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.727457:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848610432 00000100:00100000:2.0:1787380538.727466:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848610432 00000100:00100000:2.0:1787380538.727555:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 57 00000100:00100000:2.0:1787380538.727566:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+33:15649:x1874203848610432:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787380538.727586:0:19900:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380538.727617:0:19900:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a5df lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b19d expref: -99 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.727668:0:19900:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a5df lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b19d expref: 34 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.727682:0:19900:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a5df lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b19d expref: 34 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.727700:0:19900:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6ec25a9d00) 00010000:00010000:2.0:1787380538.727716:0:19900:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787380538.727719:0:19900:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46200, rc 0) 00000100:00100000:2.0:1787380538.727770:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+34:15649:x1874203848610432:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 207us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380538.727777:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 57 00000100:00100000:1.0:1787380538.731463:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380538.731559:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848610560 00000100:00100000:0.0:1787380538.731567:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848610560 00000100:00100000:0.0:1787380538.731665:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:0.0:1787380538.731674:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:864e2bc1-2781-452d-8411-8f2a646f656c+5:2400:x1874203848610560:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787380538.732756:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787380538.735281:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:864e2bc1-2781-452d-8411-8f2a646f656c+6:2400:x1874203848610560:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 3599us (3816us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787380538.735295:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:0.0:1787380538.737642:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380538.738173:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848610816 00000100:00100000:1.0:1787380538.738182:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848610816 00000100:00100000:1.0:1787380538.738237:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:1.0:1787380538.738246:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:864e2bc1-2781-452d-8411-8f2a646f656c+34:15649:x1874203848610816:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787380538.738589:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:864e2bc1-2781-452d-8411-8f2a646f656c+35:15649:x1874203848610816:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 340us (950us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1787380538.738597:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:3.0:1787380538.740385:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380538.740520:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848611072 00000100:00100000:1.0:1787380538.740528:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848611072 00000100:00100000:1.0:1787380538.740577:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00100000:1.0:1787380538.740585:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+35:15649:x1874203848611072:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787380538.740670:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+35:15649:x1874203848611072:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 86us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380538.740676:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 58 00000100:00100000:3.0:1787380538.742925:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380538.743083:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848611200 00000100:00100000:0.0:1787380538.743091:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848611200 00000100:00100000:0.0:1787380538.743139:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 59 00000100:00100000:0.0:1787380538.743147:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+35:15649:x1874203848611200:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380538.743162:0:17201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380538.743180:0:17201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a5e6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b1a4 expref: -99 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.743240:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a5ed lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.743253:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a5ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.743276:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a5ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787380538.743316:0:17201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787380538.743335:0:17201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a5ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.743598:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866a00/0xcf3c46fdcad6a5e6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1a4 expref: 37 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.743616:0:17201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a5ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1a4 expref: 36 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.743624:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6ec25a9d00) 00010000:00010000:0.0:1787380538.743627:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787380538.743630:0:17201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866c00, rc 0) 00000100:00100000:0.0:1787380538.743684:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+36:15649:x1874203848611200:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 538us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380538.743691:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 59 00000100:00100000:3.0:1787380538.748309:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380538.748941:0:19599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848611328 00000100:00100000:0.0:1787380538.748961:0:19599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848611328 00000100:00100000:0.0:1787380538.749068:0:19599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:0.0:1787380538.749079:0:19599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:864e2bc1-2781-452d-8411-8f2a646f656c+6:2399:x1874203848611328:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787380538.749096:0:19599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787380538.749113:0:19599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a5f4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b1ab expref: -99 pid: 19599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787380538.749156:0:19599:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a89433b, blocks: 0x0 00010000:00010000:0.0:1787380538.749174:0:19599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=549s v=(0 0) 00010000:00010000:0.0:1787380538.749179:0:19599:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380538.749188:0:19599:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a5f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1ab expref: 7 pid: 19599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.749204:0:19599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a5f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1ab expref: 7 pid: 19599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.749217:0:19599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6fe7866a00, rc 0) 00000100:00100000:0.0:1787380538.749275:0:19599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:864e2bc1-2781-452d-8411-8f2a646f656c+7:2399:x1874203848611328:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 198us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380538.749282:0:19599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:1.0:1787380538.752079:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.752210:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848611584 00000100:00100000:2.0:1787380538.752219:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848611584 00000100:00100000:2.0:1787380538.752275:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 60 00000100:00100000:2.0:1787380538.752285:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+36:15649:x1874203848611584:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787380538.752394:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+36:15649:x1874203848611584:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 110us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380538.752401:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 60 00000100:00100000:1.0:1787380538.761708:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.761963:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848611712 00000100:00100000:2.0:1787380538.761972:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848611712 00000100:00100000:2.0:1787380538.762042:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 61 00000100:00100000:2.0:1787380538.762062:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+36:15649:x1874203848611712:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787380538.766222:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1787380538.766253:0:17179:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1787380538.766303:0:17179:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:1.0:1787380538.766486:0:3626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad6a481 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.766500:0:3626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad6a481 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.766518:0:3626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad6a481 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.766524:0:3626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1600 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380538.766528:0:3626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad6a481 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.766535:0:3626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad6a481 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.766562:0:3626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d6ec241a900) 00010000:00010000:1.0:1787380538.766565:0:3626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787380538.766570:0:3626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad6a481 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.766576:0:3626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1600/0xcf3c46fdcad6a481 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380538.766847:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380538.766864:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867553024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787380538.766922:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380538.766976:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867553024 00000100:00100000:0.0:1787380538.766983:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867553024 00000100:00100000:0.0:1787380538.767028:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787380538.767036:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867553024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787380538.767155:0:18706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787380538.767159:0:18706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787380538.767162:0:18706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787380538.767164:0:18706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787380539 -> 1787380539 00002000:00010000:0.0:1787380538.767166:0:18706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787380538.767213:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3642:x1874203867553024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 177us (290us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787380538.767221:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:0.0:1787380538.767263:0:3642:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9d6fc30d9500/2, rc 0, transno 8589934596 00000100:00100000:0.0:1787380538.767269:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867553024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787380538.767748:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:864e2bc1-2781-452d-8411-8f2a646f656c+19:15649:x1874203848611712:12345-192.168.206.30@tcp:44:lhsmtool_posix.0 Request processed in 5693us (6055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380538.767758:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 61 00010000:00010000:3.0:1787380538.767981:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a42d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.767990:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a42d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.767997:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a42d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768002:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47c00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380538.768005:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a42d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768012:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a42d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768024:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9d6ec25a9900) 00010000:00010000:3.0:1787380538.768027:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380538.768030:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a42d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768036:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47c00/0xcf3c46fdcad6a42d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768075:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad6a434 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768082:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad6a434 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768088:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad6a434 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768093:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ffb89c400 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380538.768096:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad6a434 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768102:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad6a434 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768110:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9d6ec241a900) 00010000:00010000:3.0:1787380538.768113:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380538.768116:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad6a434 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768122:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ffb89c400/0xcf3c46fdcad6a434 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768134:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a4dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768140:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a4dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768146:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a4dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768157:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380538.768161:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a4dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768167:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a4dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768175:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9d6ec25a9a00) 00010000:00010000:3.0:1787380538.768178:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380538.768180:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a4dc lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768186:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47200/0xcf3c46fdcad6a4dc lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19900 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768201:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a561 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768206:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a561 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768211:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a561 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768216:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866e00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380538.768219:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a561 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768224:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a561 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768243:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:3.0:1787380538.768245:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380538.768248:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a561 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768254:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866e00/0xcf3c46fdcad6a561 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768266:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5d8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768272:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5d8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768279:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768285:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1e00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380538.768288:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5d8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768294:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5d8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768302:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6ec25a9d00) 00010000:00010000:3.0:1787380538.768305:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787380538.768308:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5d8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.768314:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a5d8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787380538.768466:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787380538.770778:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.770932:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848611840 00000100:00100000:2.0:1787380538.770942:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848611840 00000100:00100000:2.0:1787380538.770995:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:2.0:1787380538.771005:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:864e2bc1-2781-452d-8411-8f2a646f656c+7:2400:x1874203848611840:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787380538.771188:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:864e2bc1-2781-452d-8411-8f2a646f656c+7:2400:x1874203848611840:12345-192.168.206.30@tcp:16:lhsmtool_posix.0 Request processed in 184us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380538.771195:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 23 00000100:00100000:1.0:1787380538.783049:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.789373:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848612096 00000100:00100000:2.0:1787380538.789388:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848612096 00000100:00100000:2.0:1787380538.789755:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 62 00000100:00100000:2.0:1787380538.789770:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+15:15649:x1874203848612096:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787380538.789841:0:17200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380538.789866:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866c00/0xcf3c46fdcad6a5ed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1a4 expref: 15 pid: 17201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.789885:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6ec25a9d00) 00010000:00010000:2.0:1787380538.789889:0:17200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787380538.789917:0:17200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a5fb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.789930:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a5fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.789970:0:17200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a5fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787380538.790085:0:17200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000062143c69 reply state 00000000fa382adb transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a5fb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.790097:0:17200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47e00/0xcf3c46fdcad6a5fb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.790104:0:17200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6ec25a9d00) 00010000:00010000:2.0:1787380538.790106:0:17200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787380538.790108:0:17200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787380538.790257:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:864e2bc1-2781-452d-8411-8f2a646f656c+16:15649:x1874203848612096:12345-192.168.206.30@tcp:36:lhsmtool_posix.0 Request processed in 489us (7215us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787380538.790265:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 62 00000100:00100000:1.0:1787380538.796642:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380538.796865:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848612224 00000100:00100000:3.0:1787380538.796875:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848612224 00000100:00100000:3.0:1787380538.796942:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:3.0:1787380538.796961:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:864e2bc1-2781-452d-8411-8f2a646f656c+7:15649:x1874203848612224:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787380538.796977:0:19267:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787380538.796995:0:19267:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000286e264a/0xcf3c46fdcad6a602 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b1b2 expref: -99 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.797025:0:19267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a5f4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1ab expref: 8 pid: 19599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.797033:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380538.797037:0:19267:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787380538.797042:0:19267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000286e264a/0xcf3c46fdcad6a602 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1b2 expref: 8 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.797298:0:19267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a5f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1ab expref: 8 pid: 19599 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.797314:0:19267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a5f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1ab expref: 8 pid: 19599 timeout: 649 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380538.797328:0:19267:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19267:1874203867553152:192.168.206.30@tcp:104: 00000100:00100000:3.0:1787380538.797414:0:19267:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff88e2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787380538.800183:0:19267:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ece00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19267:1874203867553152:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380538.800214:0:19267:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000286e264a/0xcf3c46fdcad6a602 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1b2 expref: 8 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.800234:0:19267:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5fda200, rc 0) 00000100:00100000:3.0:1787380538.800288:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:864e2bc1-2781-452d-8411-8f2a646f656c+8:15649:x1874203848612224:12345-192.168.206.30@tcp:101:lhsmtool_posix.0 Request processed in 3337us (3656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380538.800297:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 24 00000100:00100000:1.0:1787380538.805241:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380538.805781:0:19536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848612352 00000100:00100000:0.0:1787380538.805790:0:19536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848612352 00010000:00010000:0.0:1787380538.805860:0:19536:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a5f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1ab expref: 8 pid: 19599 timeout: 649 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380538.805898:0:19536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:0.0:1787380538.805908:0:19536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:864e2bc1-2781-452d-8411-8f2a646f656c+8:2399:x1874203848612352:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787380538.805921:0:19536:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787380538.805939:0:19536:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a5f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1ab expref: 8 pid: 19599 timeout: 649 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.805964:0:19536:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a5f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1ab expref: 8 pid: 19599 timeout: 649 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.805986:0:19536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002168ed30/0xcf3c46fdcad6a5f4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1ab expref: 8 pid: 19599 timeout: 649 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.806000:0:19536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380538.806005:0:19536:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787380538.806011:0:19536:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000286e264a/0xcf3c46fdcad6a602 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1b2 expref: 7 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.806038:0:19536:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000286e264a/0xcf3c46fdcad6a602 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1b2 expref: 7 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.806081:0:19536:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000286e264a/0xcf3c46fdcad6a602 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1b2 expref: 7 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380538.806094:0:19536:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc30d9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:19536:1874203867553280:192.168.206.30@tcp:105: 00000100:00100000:0.0:1787380538.806155:0:19536:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc9563c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380538.819090:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.819292:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848612480 00000100:00100000:2.0:1787380538.819302:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848612480 00000100:00100000:2.0:1787380538.819364:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:2.0:1787380538.819374:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:864e2bc1-2781-452d-8411-8f2a646f656c+8:2399:x1874203848612480:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787380538.819520:0:18706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787380538.819524:0:18706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1787380539 00002000:00010000:2.0:1787380538.819526:0:18706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1787380538 00002000:00010000:2.0:1787380538.819528:0:18706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1787380539 -> 1787380539 00002000:00010000:2.0:1787380538.819531:0:18706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1787380538.819594:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:864e2bc1-2781-452d-8411-8f2a646f656c+9:2399:x1874203848612480:12345-192.168.206.30@tcp:2:lhsmtool_posix.0 Request processed in 221us (512us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787380538.819602:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 25 00000100:00100000:0.0:1787380538.824896:0:19536:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc30d9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:19536:1874203867553280:192.168.206.30@tcp:105: 00010000:00010000:0.0:1787380538.824935:0:19536:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787380538.825004:0:19536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:864e2bc1-2781-452d-8411-8f2a646f656c+8:2399:x1874203848612352:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 19095us (19769us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380538.825015:0:19536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 19 00000100:00100000:1.0:1787380538.828122:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.828268:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848612608 00000100:00100000:2.0:1787380538.828276:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848612608 00000100:00100000:2.0:1787380538.828330:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 26 00000100:00100000:2.0:1787380538.828339:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec310b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:864e2bc1-2781-452d-8411-8f2a646f656c+8:2399:x1874203848612608:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787380538.828386:0:18707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad6a609 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.828405:0:18707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000286e264a/0xcf3c46fdcad6a602 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1b2 expref: 8 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.828414:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380538.828419:0:18707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787380538.828423:0:18707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad6a609 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.828455:0:18707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000286e264a/0xcf3c46fdcad6a602 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1b2 expref: 8 pid: 19267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.828471:0:18707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000286e264a/0xcf3c46fdcad6a602 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1b2 expref: 8 pid: 19267 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380538.828486:0:18707:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c9b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18707:1874203867553408:192.168.206.30@tcp:104: 00000100:00100000:2.0:1787380538.828565:0:18707:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6feb6bcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787380538.835302:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.835874:0:18707:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c9b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:18707:1874203867553408:192.168.206.30@tcp:104: 00010000:00010000:2.0:1787380538.835899:0:18707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad6a609 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380538.836528:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848612736 00000100:00100000:3.0:1787380538.836537:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848612736 00010000:00010000:3.0:1787380538.836581:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000286e264a/0xcf3c46fdcad6a602 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1b2 expref: 9 pid: 19267 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380538.836622:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 20 00000100:00100000:3.0:1787380538.836629:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3108000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:864e2bc1-2781-452d-8411-8f2a646f656c+9:2400:x1874203848612736:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380538.836642:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380538.836661:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000286e264a/0xcf3c46fdcad6a602 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1b2 expref: 9 pid: 19267 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.836676:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000286e264a/0xcf3c46fdcad6a602 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1b2 expref: 9 pid: 19267 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.836697:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000286e264a/0xcf3c46fdcad6a602 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1b2 expref: 9 pid: 19267 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.836738:0:17185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787380538.836743:0:17185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787380538.836748:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad6a609 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.836758:0:17185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad6a609 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.836793:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380538.836895:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3108000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:864e2bc1-2781-452d-8411-8f2a646f656c+8:2400:x1874203848612736:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 265us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380538.836903:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 20 00010000:00010000:0.0:1787380538.837175:0:18707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad6a609 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.837185:0:18707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad6a609 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.837204:0:18707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad6a609 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.837212:0:18707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad6a609 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.837231:0:18707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad6a609 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.837237:0:18707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d46c00 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380538.837241:0:18707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad6a609 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.837250:0:18707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad6a609 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.837264:0:18707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad6a609 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.837271:0:18707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000258ae612/0xcf3c46fdcad6a609 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787380538.837317:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec310b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:864e2bc1-2781-452d-8411-8f2a646f656c+7:2399:x1874203848612608:12345-192.168.206.30@tcp:1:lhsmtool_posix.0 Request processed in 8978us (9202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380538.837325:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 26 00000100:00100000:3.0:1787380538.859753:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380538.861033:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848612992 00000100:00100000:0.0:1787380538.861046:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848612992 00000100:00100000:1.0:1787380538.861351:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 63 00000100:00100000:1.0:1787380538.861363:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+16:15649:x1874203848612992:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787380538.861449:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a610 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.861491:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a55a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b173 expref: 16 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.861502:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a610 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.861536:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a55a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b173 expref: 16 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.861552:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a55a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b173 expref: 16 pid: 17199 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380538.861568:0:17201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1874203867553536:192.168.206.30@tcp:104: 00000100:00100000:1.0:1787380538.861670:0:17201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc39e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787380538.867371:0:17201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1874203867553536:192.168.206.30@tcp:104: 00010000:00010000:3.0:1787380538.867398:0:17201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a610 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380538.867506:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.867729:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848613120 00000100:00100000:2.0:1787380538.867736:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848613120 00010000:00010000:2.0:1787380538.868010:0:17184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a55a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b173 expref: 17 pid: 17199 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380538.868095:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 21 00000100:00100000:2.0:1787380538.868106:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:864e2bc1-2781-452d-8411-8f2a646f656c+17:2399:x1874203848613120:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787380538.868120:0:17184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787380538.868127:0:17184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a55a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b173 expref: 17 pid: 17199 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.868142:0:17184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a55a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b173 expref: 17 pid: 17199 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.868163:0:17184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46000/0xcf3c46fdcad6a55a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b173 expref: 17 pid: 17199 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.868177:0:17184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:2.0:1787380538.868182:0:17184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a576 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b181 expref: 16 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.868191:0:17184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a610 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.868198:0:17184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a610 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.868223:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a610 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.868254:0:17184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787380538.868321:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:864e2bc1-2781-452d-8411-8f2a646f656c+16:2399:x1874203848613120:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 216us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380538.868329:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 21 00010000:00010000:3.0:1787380538.868387:0:17201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a610 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.868394:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a610 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.868579:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda200/0xcf3c46fdcad6a617 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.868591:0:17201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a5df lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b19d expref: 16 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.868617:0:17201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda200/0xcf3c46fdcad6a617 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.868647:0:17201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a5df lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b19d expref: 16 pid: 19900 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.868661:0:17201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a5df lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b19d expref: 16 pid: 19900 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380538.868674:0:17201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1874203867553664:192.168.206.30@tcp:104: 00000100:00100000:3.0:1787380538.868725:0:17201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ff88e20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380538.876378:0:17201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1874203867553664:192.168.206.30@tcp:104: 00010000:00010000:1.0:1787380538.876406:0:17201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda200/0xcf3c46fdcad6a617 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380538.876773:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380538.876973:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848613248 00000100:00100000:3.0:1787380538.876981:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848613248 00010000:00010000:3.0:1787380538.877015:0:17185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a5df lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b19d expref: 17 pid: 19900 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380538.877099:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 22 00000100:00100000:3.0:1787380538.877109:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec310b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:864e2bc1-2781-452d-8411-8f2a646f656c+17:2400:x1874203848613248:12345-192.168.206.30@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787380538.877124:0:17185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787380538.877131:0:17185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a5df lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b19d expref: 17 pid: 19900 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.877144:0:17185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a5df lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b19d expref: 17 pid: 19900 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.877164:0:17185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46200/0xcf3c46fdcad6a5df lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b19d expref: 17 pid: 19900 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.877192:0:17185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6ec25a9d00) 00010000:00010000:3.0:1787380538.877197:0:17185:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda200/0xcf3c46fdcad6a617 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.877206:0:17185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda200/0xcf3c46fdcad6a617 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.877213:0:17185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda200/0xcf3c46fdcad6a617 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.877241:0:17185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787380538.877297:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec310b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:864e2bc1-2781-452d-8411-8f2a646f656c+16:2400:x1874203848613248:12345-192.168.206.30@tcp:103:ldlm_bl.0 Request processed in 189us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380538.877305:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 22 00010000:00010000:1.0:1787380538.880358:0:17201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda200/0xcf3c46fdcad6a617 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.880374:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda200/0xcf3c46fdcad6a617 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787380538.880532:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1787380538.880653:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1787380538.880718:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1787380538.880802:0:17201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17201:1874203867553792:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787380538.880935:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380538.880983:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867553792 00000100:00100000:1.0:1787380538.880990:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867553792 00000100:00100000:1.0:1787380538.881031:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787380538.881040:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17201:x1874203867553792:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787380538.881115:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17201:x1874203867553792:12345-0@lo:1000:mdt00_002.0 Request processed in 76us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380538.881123:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787380538.881147:0:17201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc39ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787380538.881169:0:17201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17201:1874203867553792:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787380538.881309:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1787380538.881377:0:17201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17201:1874203867553920:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787380538.881404:0:17201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380538.881428:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867553920 00000100:00100000:1.0:1787380538.881432:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867553920 00000100:00100000:1.0:1787380538.881454:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787380538.881460:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17201:x1874203867553920:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787380538.881547:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17201:x1874203867553920:12345-0@lo:1000:mdt00_002.0 Request processed in 86us (140us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1787380538.881553:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787380538.881570:0:17201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc39ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787380538.881586:0:17201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17201:1874203867553920:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787380538.881612:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda200/0xcf3c46fdcad6a617 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.881631:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda200/0xcf3c46fdcad6a617 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.881638:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda200/0xcf3c46fdcad6a617 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.881644:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fda200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380538.881648:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda200/0xcf3c46fdcad6a617 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.881655:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda200/0xcf3c46fdcad6a617 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.881669:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6ec25a9d00) 00010000:00010000:1.0:1787380538.881672:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787380538.881676:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda200/0xcf3c46fdcad6a617 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.881683:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda200/0xcf3c46fdcad6a617 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.881715:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6a56f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.881720:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6a56f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.881726:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6a56f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.881730:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6fe7866200 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:1.0:1787380538.881739:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6a56f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.881745:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6a56f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.881754:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:1.0:1787380538.881757:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787380538.881763:0:17201:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a576 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b181 expref: 19 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.881774:0:17201:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a576 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b181 expref: 19 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.881784:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a576 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b181 expref: 19 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380538.881866:0:17201:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47600/0xcf3c46fdcad6a576 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b181 expref: 19 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787380538.881878:0:17201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec310ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1874203867554048:192.168.206.30@tcp:105: 00000100:00100000:1.0:1787380538.881936:0:17201:0:(client.c:2702:ptlrpc_set_wait()) set ffff9d6ffc39e240 going to sleep for 11 seconds 00000100:00100000:3.0:1787380538.891361:0:17201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec310ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17201:1874203867554048:192.168.206.30@tcp:105: 00010000:00010000:3.0:1787380538.891389:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6a56f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.891399:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6fe7866200/0xcf3c46fdcad6a56f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.891429:0:17201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbc00/0xcf3c46fdcad6a61e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.891441:0:17201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbc00/0xcf3c46fdcad6a61e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.891451:0:17201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbc00/0xcf3c46fdcad6a61e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.891477:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbc00/0xcf3c46fdcad6a61e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.891482:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbc00/0xcf3c46fdcad6a61e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.891488:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbc00/0xcf3c46fdcad6a61e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.891492:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fdbc00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380538.891496:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbc00/0xcf3c46fdcad6a61e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.891503:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbc00/0xcf3c46fdcad6a61e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.891513:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:3.0:1787380538.891515:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787380538.891519:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbc00/0xcf3c46fdcad6a61e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.891524:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fdbc00/0xcf3c46fdcad6a61e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.891532:0:17201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a610 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.891596:0:17201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a610 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.891603:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a610 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.891613:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df1e00 already unused, calling callback (ffffffffc19bc4f0) 00010000:00010000:3.0:1787380538.891616:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a610 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.891622:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a610 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.891630:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:3.0:1787380538.891632:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787380538.891635:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a610 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.891641:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ec3df1e00/0xcf3c46fdcad6a610 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380538.891965:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+19:15649:x1874203848612992:12345-192.168.206.30@tcp:57:lhsmtool_posix.0 Request processed in 30603us (32217us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1787380538.891974:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 63 00000020:00080000:3.0:1787380538.891980:0:17201:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787380538.892355:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380538.892431:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848613376 00000100:00100000:2.0:1787380538.892439:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848613376 00000100:00100000:2.0:1787380538.892484:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:2.0:1787380538.892492:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ffc94b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:864e2bc1-2781-452d-8411-8f2a646f656c+19:15648:x1874203848613376:12345-192.168.206.30@tcp:49:dd.0 00000100:00100000:2.0:1787380538.892582:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ffc94b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:864e2bc1-2781-452d-8411-8f2a646f656c+19:15648:x1874203848613376:12345-192.168.206.30@tcp:49:dd.0 Request processed in 90us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380538.892589:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 10 00000040:00080000:0.0:1787380538.895437:0:17233:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787380538.895447:0:17233:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787380538.895463:0:17233:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787380538.895469:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787380538.897193:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:3.0:1787380538.897330:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848613632 00000100:00100000:3.0:1787380538.897339:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848613632 00000100:00100000:3.0:1787380538.897398:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 11 00000100:00100000:3.0:1787380538.897408:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:864e2bc1-2781-452d-8411-8f2a646f656c+19:15649:x1874203848613632:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787380538.897639:0:17203:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787380538.897670:0:17203:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00000100:00100000:0.0:1787380538.897704:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00010000:00010000:3.0:1787380538.897710:0:17203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda400/0xcf3c46fdcad6a625 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.897743:0:17203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda400/0xcf3c46fdcad6a625 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.897753:0:17203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda400/0xcf3c46fdcad6a625 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.897761:0:17203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda400/0xcf3c46fdcad6a625 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.897767:0:17203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda400/0xcf3c46fdcad6a625 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.897772:0:17203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda400/0xcf3c46fdcad6a625 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787380538.897791:0:17203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787380538.897895:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848613760 00000100:00100000:2.0:1787380538.897901:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848613760 00000100:00100000:2.0:1787380538.897934:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 64 00000100:00100000:2.0:1787380538.897943:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:864e2bc1-2781-452d-8411-8f2a646f656c+22:15648:x1874203848613760:12345-192.168.206.30@tcp:101:dd.0 00010000:00010000:2.0:1787380538.897966:0:17199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787380538.897980:0:17199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a62c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64a85c2cdcf0b1b9 expref: -99 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787380538.897994:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:864e2bc1-2781-452d-8411-8f2a646f656c+23:15649:x1874203848613632:12345-192.168.206.30@tcp:35:lhsmtool_posix.0 Request processed in 586us (808us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787380538.898002:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 11 00000020:00080000:3.0:1787380538.898007:0:17203:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787380538.898024:0:17199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a633 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.898035:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a633 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.898052:0:17199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a633 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.898145:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d47000/0xcf3c46fdcad6a62c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1b9 expref: 23 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.898161:0:17199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5d46e00/0xcf3c46fdcad6a633 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.30@tcp remote: 0x64a85c2cdcf0b1b9 expref: 22 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380538.898170:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9d6ec25a9000) 00010000:00010000:2.0:1787380538.898173:0:17199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787380538.898177:0:17199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9d6ff5d46e00, rc 0) 00010000:00010000:0.0:1787380538.898183:0:17188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787380538.898191:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda400/0xcf3c46fdcad6a625 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.898201:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5fda400 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:0.0:1787380538.898205:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda400/0xcf3c46fdcad6a625 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380538.898212:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:864e2bc1-2781-452d-8411-8f2a646f656c+22:15648:x1874203848613760:12345-192.168.206.30@tcp:101:dd.0 Request processed in 269us (507us total) trans 0 rc 0/0 00010000:00010000:0.0:1787380538.898216:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda400/0xcf3c46fdcad6a625 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.898227:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9d6ec25a9d00) 00010000:00010000:0.0:1787380538.898230:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787380538.898233:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda400/0xcf3c46fdcad6a625 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.898238:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9d6ff5fda400/0xcf3c46fdcad6a625 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787380538.898248:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380538.898249:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787380538.898251:0:17188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787380538.898662:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 64 00000100:00100000:0.0:1787380539.040836:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380539.040878:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380539.040915:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380539.040943:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380539.040991:0:19267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848614144 00000100:00100000:0.0:1787380539.041000:0:19267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848614144 00000100:00100000:1.0:1787380539.041001:0:19599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848614656 00000100:00100000:1.0:1787380539.041005:0:19599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848614656 00000100:00100000:0.0:1787380539.041063:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:0.0:1787380539.041074:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:864e2bc1-2781-452d-8411-8f2a646f656c+5:2397:x1874203848614144:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:2.0:1787380539.041085:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848614400 00000100:00100000:2.0:1787380539.041093:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848614400 00000100:00100000:3.0:1787380539.041156:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848613888 00000100:00100000:3.0:1787380539.041161:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848613888 00000100:00100000:3.0:1787380539.041189:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 164 00000100:00100000:0.0:1787380539.041465:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:864e2bc1-2781-452d-8411-8f2a646f656c+5:2397:x1874203848614144:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 393us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380539.041473:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 8 00000100:00100000:3.0:1787380539.041507:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:2397:x1874203848613888:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380539.041540:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ab8d4fb0-c401-4cf6-8006-07960a0f9a13+13:2397:x1874203848613888:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 345us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380539.041546:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 164 00000100:00100000:1.0:1787380539.042498:0:19599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00100000:1.0:1787380539.042510:0:19599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+5:2397:x1874203848614656:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380539.042552:0:19599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+5:2397:x1874203848614656:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 44us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380539.042573:0:19599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 9 00000100:00080000:0.0:1787380539.047098:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787380539.047109:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787380539.047113:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787380539.047145:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:2.0:1787380539.047272:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848614016 00000100:00100000:2.0:1787380539.047280:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848614016 00000100:00080000:2.0:1787380539.047303:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787380539.047325:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 51 00000100:00100000:2.0:1787380539.047334:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+5:2397:x1874203848614400:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:3.0:1787380539.047590:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 52 00000100:00100000:3.0:1787380539.047613:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+5:2397:x1874203848614016:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:1.0:1787380539.049412:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380539.049455:0:3632:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380539.049515:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848614528 00000100:00100000:1.0:1787380539.049522:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848614528 00000100:00100000:1.0:1787380539.049582:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:1.0:1787380539.049592:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+5:2397:x1874203848614528:12345-192.168.206.30@tcp:400:kworker.0 00000100:00100000:0.0:1787380539.049608:0:17199:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787380539.049617:0:17199:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1787380539.049661:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+5:2397:x1874203848614528:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 71us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380539.049670:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 10 00000100:00100000:1.0:1787380539.049704:0:17200:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787380539.049712:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848614272 00000100:00100000:1.0:1787380539.049717:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848614272 00000100:00100000:1.0:1787380539.049749:0:17199:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1787380539.049756:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 53 00000100:00100000:1.0:1787380539.049762:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:2397:x1874203848614272:12345-192.168.206.30@tcp:400:kworker.0 00000100:00080000:0.0:1787380539.050077:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787380539.050082:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787380539.052723:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+6:2397:x1874203848614272:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 2955us (3312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380539.052736:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 53 00000100:00100000:2.0:1787380539.054875:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb3c303c-174e-4b74-a8fe-d1e7ede1cc83+5:2397:x1874203848614400:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 7530us (13946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380539.054890:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 51 00000100:00100000:3.0:1787380539.062359:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:864e2bc1-2781-452d-8411-8f2a646f656c+5:2397:x1874203848614016:12345-192.168.206.30@tcp:400:kworker.0 Request processed in 14738us (15209us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380539.062374:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 52 00000100:00100000:0.0:1787380539.087037:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:0.0:1787380539.087086:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.30@tcp (source: 12345-192.168.206.30@tcp) 00000100:00100000:1.0:1787380539.087188:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848614912 00000100:00100000:1.0:1787380539.087197:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848614912 00000100:00100000:1.0:1787380539.087257:0:18710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203848614784 00000100:00100000:1.0:1787380539.087261:0:18710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203848614784 00000100:00100000:1.0:1787380539.087282:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:1.0:1787380539.087291:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:864e2bc1-2781-452d-8411-8f2a646f656c+8:2399:x1874203848614912:12345-192.168.206.30@tcp:4:dd.0 00002000:00010000:1.0:1787380539.087349:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a89433b, atime: 0x6a89433a, ctime: 0x6a89433b, blocks: 0x0 00010000:00010000:1.0:1787380539.087358:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000720d6a92/0xcf3c46fdcad6a63a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380539.087372:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=549s v=(0 0) 00010000:00010000:1.0:1787380539.087376:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787380539.087381:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000720d6a92/0xcf3c46fdcad6a63a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787380539.087393:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000720d6a92/0xcf3c46fdcad6a63a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787380539.167490:0:19519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1787380539.167505:0:19519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1787380539.167684:0:18710:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1787380539.167689:0:18710:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1787380539.167730:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000720d6a92/0xcf3c46fdcad6a63a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.167743:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000720d6a92/0xcf3c46fdcad6a63a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.167751:0:18710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000720d6a92/0xcf3c46fdcad6a63a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.167758:0:18710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ec3df0200 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380539.167763:0:18710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000720d6a92/0xcf3c46fdcad6a63a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.167771:0:18710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000720d6a92/0xcf3c46fdcad6a63a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.167790:0:18710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000720d6a92/0xcf3c46fdcad6a63a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.167797:0:18710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000720d6a92/0xcf3c46fdcad6a63a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380539.168107:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:864e2bc1-2781-452d-8411-8f2a646f656c+6:2399:x1874203848614912:12345-192.168.206.30@tcp:4:dd.0 Request processed in 80811us (81074us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787380539.168122:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 0 00000100:00100000:2.0:1787380539.168154:0:18710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.30@tcp, seq: 1 00000100:00100000:2.0:1787380539.168165:0:18710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc30d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:864e2bc1-2781-452d-8411-8f2a646f656c+5:2399:x1874203848614784:12345-192.168.206.30@tcp:4:dd.0 00002000:00010000:2.0:1787380539.168209:0:18710:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 7654321, mtime: 0x6a89433b, atime: 0x6a89433a, ctime: 0x6a89433b, blocks: 0x1a68 00010000:00010000:2.0:1787380539.168216:0:18710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fde39ac/0xcf3c46fdcad6a641 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.168226:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=549s v=(0 0) 00010000:00010000:2.0:1787380539.168230:0:18710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787380539.168236:0:18710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fde39ac/0xcf3c46fdcad6a641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.168247:0:18710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fde39ac/0xcf3c46fdcad6a641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787380539.215931:0:19519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1787380539.218301:0:18710:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1787380539.218334:0:18710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fde39ac/0xcf3c46fdcad6a641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.218347:0:18710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fde39ac/0xcf3c46fdcad6a641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.218357:0:18710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fde39ac/0xcf3c46fdcad6a641 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.218364:0:18710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9d6ff5d47000 already unused, calling callback (ffffffffc0d92e90) 00010000:00010000:2.0:1787380539.218369:0:18710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fde39ac/0xcf3c46fdcad6a641 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.218378:0:18710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fde39ac/0xcf3c46fdcad6a641 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.218410:0:18710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fde39ac/0xcf3c46fdcad6a641 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787380539.218417:0:18710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fde39ac/0xcf3c46fdcad6a641 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787380539.219047:0:18710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc30d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:864e2bc1-2781-452d-8411-8f2a646f656c+5:2399:x1874203848614784:12345-192.168.206.30@tcp:4:dd.0 Request processed in 50880us (131956us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787380539.219058:0:18710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.30@tcp, seq: 1 00010000:00010000:2.0:1787380539.276628:0:17187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787380539.532676:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec34ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867554304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787380539.532739:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867554176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787380539.532760:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380539.532785:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380539.532802:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867554816:0@lo:400:kworker.0 00000100:00100000:0.0:1787380539.532834:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867554688:0@lo:400:kworker.0 00000100:00100000:0.0:1787380539.532873:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380539.532879:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380539.532893:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867555200:0@lo:400:kworker.0 00000100:00100000:3.0:1787380539.532904:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867555328:0@lo:400:kworker.0 00000100:00100000:0.0:1787380539.532921:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380539.532940:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380539.532944:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1874203867555712:0@lo:400:kworker.0 00000100:00100000:3.0:1787380539.532976:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867555840:0@lo:400:kworker.0 00000100:00100000:0.0:1787380539.532985:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380539.533010:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787380539.533016:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380539.533021:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867554560:0@lo:400:kworker.0 00000100:00100000:3.0:1787380539.533040:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1787380539.533049:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3639:1874203867554432:0@lo:400:kworker.0 00000100:00100000:0.0:1787380539.533055:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380539.533078:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867555072:0@lo:400:kworker.0 00000100:00100000:3.0:1787380539.533085:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380539.533113:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380539.533122:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867554944:0@lo:400:kworker.0 00000100:00100000:0.0:1787380539.533138:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867555584:0@lo:400:kworker.0 00000100:00100000:3.0:1787380539.533150:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380539.533170:0:3639:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6fc3b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867555456:0@lo:400:kworker.0 00000100:00100000:0.0:1787380539.533186:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380539.533215:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867554304 00000100:00100000:3.0:1787380539.533222:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867554304 00000100:00100000:3.0:1787380539.533273:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867554176 00000100:00100000:3.0:1787380539.533277:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867554176 00000100:00100000:2.0:1787380539.533349:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867554688 00000100:00100000:2.0:1787380539.533354:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867554688 00000100:00100000:0.0:1787380539.533374:0:3642:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787380539.533385:0:3642:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867556096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380539.533388:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867555200 00000100:00100000:2.0:1787380539.533392:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867555200 00000100:00100000:2.0:1787380539.533415:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867555072 00000100:00100000:0.0:1787380539.533418:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787380539.533420:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867555072 00000100:00100000:2.0:1787380539.533468:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787380539.533477:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867554688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380539.533531:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867554688:12345-0@lo:400:kworker.0 Request processed in 55us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380539.533571:0:18709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867556096 00000100:00100000:3.0:1787380539.533575:0:18709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867556096 00000100:00100000:3.0:1787380539.533586:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787380539.533599:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3639:x1874203867554304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787380539.533614:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:1.0:1787380539.535199:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867554560 00000100:00100000:1.0:1787380539.535210:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867554560 00000100:00100000:1.0:1787380539.535260:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867554944 00000100:00100000:1.0:1787380539.535263:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867554944 00000100:00100000:1.0:1787380539.535281:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787380539.535289:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867554560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787380539.535355:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3642:x1874203867554560:12345-0@lo:400:kworker.0 Request processed in 66us (2300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380539.535362:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787380539.535378:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787380539.535385:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867554944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380539.535455:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787380539.535466:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3642:x1874203867555200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380539.535516:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3642:x1874203867555200:12345-0@lo:400:kworker.0 Request processed in 53us (2595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380539.535523:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787380539.535540:0:19267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787380539.535546:0:19267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3642:x1874203867555072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787380539.535575:0:19267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3642:x1874203867555072:12345-0@lo:400:kworker.0 Request processed in 29us (2464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380539.535581:0:19267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787380539.535602:0:17194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867554432 00000100:00100000:0.0:1787380539.535606:0:17194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867554432 00000100:00100000:0.0:1787380539.535639:0:17194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787380539.535645:0:17194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6feec79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:3639:x1874203867554432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787380539.538120:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867554304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4513us (5353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380539.538134:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787380539.538169:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787380539.538254:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867554176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787380539.538284:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787380539.538337:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3642:x1874203867554176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 160us (5552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380539.538344:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787380539.538357:0:18709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787380539.538364:0:18709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874203867556096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787380539.538374:0:18709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787380539.538398:0:18709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3642:x1874203867556096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (4982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787380539.538404:0:18709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787380539.538438:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867555968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787380539.538472:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380539.538589:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787380539.538803:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec34ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867554304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787380539.540569:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787380539.540645:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867556096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787380539.540660:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867554560:0@lo:400:kworker.0 00000100:00100000:2.0:1787380539.540672:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867555072:0@lo:400:kworker.0 00000100:00100000:2.0:1787380539.540685:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867554176:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787380539.540777:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3642:1874203867554688:0@lo:400:kworker.0 00000100:00100000:2.0:1787380539.540787:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3642:1874203867555200:0@lo:400:kworker.0 00000100:00100000:2.0:1787380539.540902:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867554816 00000100:00100000:2.0:1787380539.540909:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867554816 00000100:00100000:2.0:1787380539.540941:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867555328 00000100:00100000:2.0:1787380539.540944:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867555328 00000100:00100000:2.0:1787380539.540968:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867555712 00000100:00100000:2.0:1787380539.540971:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867555712 00000100:00100000:2.0:1787380539.540986:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867555840 00000100:00100000:2.0:1787380539.540989:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867555840 00000100:00100000:2.0:1787380539.541001:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867555584 00000100:00100000:2.0:1787380539.541003:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867555584 00000100:00100000:2.0:1787380539.541014:0:19900:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867555456 00000100:00100000:2.0:1787380539.541017:0:19900:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867555456 00000100:00100000:2.0:1787380539.541028:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787380539.541035:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec34ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867554816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380539.541106:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec34ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1874203867554816:12345-0@lo:400:kworker.0 Request processed in 70us (8228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380539.541112:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787380539.541124:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787380539.541129:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867555328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380539.541154:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1874203867555328:12345-0@lo:400:kworker.0 Request processed in 26us (8217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380539.541160:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787380539.541170:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787380539.541174:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6fc3b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874203867555712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380539.541206:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6fc3b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3642:x1874203867555712:12345-0@lo:400:kworker.0 Request processed in 31us (8221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380539.541217:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787380539.541243:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3642:1874203867555712:0@lo:400:kworker.0 00000100:00100000:2.0:1787380539.541261:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787380539.541266:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867555840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380539.541292:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1874203867555840:12345-0@lo:400:kworker.0 Request processed in 26us (8279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380539.541296:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787380539.541306:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787380539.541311:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec20a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867555584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380539.541338:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec20a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3642:x1874203867555584:12345-0@lo:400:kworker.0 Request processed in 27us (8154us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380539.541343:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1787380539.541364:0:3642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc3b67b80 x1874203867555584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787380539.541373:0:3642:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3642:1874203867555584:0@lo:400:kworker.0 00000100:00100000:2.0:1787380539.541388:0:19900:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787380539.541393:0:19900:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867555456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787380539.541415:0:19900:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1874203867555456:12345-0@lo:400:kworker.0 Request processed in 23us (2827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787380539.541420:0:19900:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1787380539.541687:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787380539.541691:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787380539.541694:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787380539.541696:0:17195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787380539.543592:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1874203867554944:12345-0@lo:400:kworker.0 Request processed in 7335us (9569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380539.543620:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787380539.543666:0:18708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867555968 00000100:00100000:1.0:1787380539.543673:0:18708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867555968 00000100:00100000:1.0:1787380539.543726:0:18708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787380539.543742:0:18708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ff5f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867555968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787380539.543779:0:18708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3485696 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:1.0:1787380539.544308:0:18708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ff5f0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1874203867555968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 565us (5833us total) trans 0 rc 0/0 00000100:00100000:1.0:1787380539.544316:0:18708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787380539.544375:0:3640:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1787380539.544381:0:3640:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9d6fc30d9500, transno 8589934596 00000004:00080000:1.0:1787380539.544398:0:3640:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1787380539.544421:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3640:1874203867555968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787380539.548267:0:17194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6feec79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7d8d387d-7e15-4118-9d7b-f7697dc8c103+24:3639:x1874203867554432:12345-0@lo:400:kworker.0 Request processed in 12612us (15174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380539.548283:0:17194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787380539.548407:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7d8d387d-7e15-4118-9d7b-f7697dc8c103:3639:1874203867554432:0@lo:400:kworker.0 00000100:00100000:3.0:1787380539.548425:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3639:1874203867554944:0@lo:400:kworker.0 00000100:00100000:3.0:1787380539.548437:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3639:1874203867555456:0@lo:400:kworker.0 00000100:00100000:3.0:1787380539.548472:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3639:1874203867554816:0@lo:400:kworker.0 00000100:00100000:3.0:1787380539.548483:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3639:1874203867555328:0@lo:400:kworker.0 00010000:00080000:3.0:1787380539.548569:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9d6fc3b66680 x1874203867555840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787380555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787380539.548580:0:3639:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6fc3b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3639:1874203867555840:0@lo:400:kworker.0 00000100:00100000:1.0:1787380540.044140:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787380540.044163:0:3641:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ff5f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867556224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787380540.044233:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787380540.044442:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787380540.044454:0:3640:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9d6ec3c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867556352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787380540.044483:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787380540.046077:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867556224 00000100:00100000:0.0:1787380540.046086:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867556224 00000100:00100000:0.0:1787380540.046544:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874203867556352 00000100:00100000:0.0:1787380540.046548:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874203867556352 00000100:00100000:0.0:1787380540.046566:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787380540.046573:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec3108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867556224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787380540.046614:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787380540.046672:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec3108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1874203867556224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (2440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380540.046680:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787380540.046693:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787380540.046698:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9d6ec310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867556352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787380540.046713:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787380540.046744:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9d6ec310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1874203867556352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (2260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787380540.046750:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787380540.046832:0:3641:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ff5f09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3641:1874203867556224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787380540.046869:0:3640:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9d6ec3c9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3640:1874203867556352:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787380540.300989:0:20230:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787380540.838161:0:20381:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:0.0:1787380541.018740:0:17958:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787380541.324230:0:20229:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 41783 lines, 41783 kept, 0 dropped, 0 bad.